Hello and welcome to Eye on AI. This week was a big one for AI research, and we’re going to start by diving into perhaps the most comprehensive attempt to interrogate the transparency of leading LLMs yet.
The Stanford Institute for Human-Centered AI released its Foundation Model Transparency Index, which rates major foundational model developers to evaluate their transparency. Driven by the fact that public transparency around these models is plummeting just as the societal impacts of them are skyrocketing, the researchers evaluated 100 different indicators of transparency across how a company builds a foundation model, how that model works, and how it’s actually used. They focused on 10 major foundation model developers—OpenAI, Anthropic, Google, Meta, Amazon, Inflection, AI21 Labs, Cohere, Hugging Face, and Stability—and designated a single flagship model from each developer for evaluation.
