Key facts
- In the Weights is a new website that ranks how well AI models recall individuals.
- The tool queries various large language models (LLMs) to assess their knowledge of people.
- It assigns a 'strength score' based on the AI's ability to describe a person without using web search.
- The creators, Thomas Dimson and Joey Flynn, are former OpenAI employees.
- The website aims to reflect an individual's perceived importance in the training data of AI models.
A new website called In the Weights, developed by former OpenAI employees Thomas Dimson and Joey Flynn, aims to quantify how well artificial intelligence models 'remember' individuals. The tool queries various large language models (LLMs), including Grok, Gemini, multiple GPT versions, Claude, and Llama, asking them to identify and describe specific people without using web search. Based on the AI's responses, In the Weights assigns a 'strength score' to each name, indicating its perceived importance in the AI's training data.
The website features a leaderboard showcasing individuals with the highest scores. Currently, actor Macaulay Culkin leads with a score of 988, followed by opera singer Luciano Pavarotti. The results also highlight which models provided answers and can reveal instances of AI hallucination, such as a GPT-5.4 Mini instance misidentifying Anthony Ha.
Dimson explained that the project was conceived after leaving OpenAI, driven by the idea that traditional Google vanity searches are becoming less relevant as more information consumption shifts to LLMs. He noted the intriguing concept of lives being encoded as numerical parameters within AI. The reception has reportedly been significant, with many users expressing a desire to see their 'immortality' within superintelligence.
