Which organization's large language model (LLM) will be ranked first as of 16 May 2025, according to the Large Model Systems Organization (LMSYS Org)?
Closing May 16, 2025 07:01AM UTC
Technology companies and organizations are racing to develop the best performing chatbots (The Verge). The question will be suspended on 15 May 2025 and the outcome determined using the ranks as reported by LMSYS Org at approximately 5:00PM ET on 16 May 2025 (LMSYS, see "Rank* (UB)"). As of 8 May 2024, OpenAI was ranked first with its "GPT-4-Turbo-2024-04-09" model with an Arena Elo of 1258. For more information on how the leaderboard is constructed, see (LMSYS Blog). In the event of a tie for first place by LLMs of different organizations, the LLM with the higher Arena Elo score will be considered first, followed by the "Votes" total.
Confused? Check our FAQ or ask us for help. To learn more about Good Judgment and Superforecasting, click here.
To learn more about how you can become a Superforecaster, see here. For other posts from our Insights blog, click here.
| Possible Answer | Crowd Forecast | Change in last 24 hours | Change in last week | Change in last month |
|---|---|---|---|---|
| Anthropic | 9.00% | 0% | +0.78% | -1.20% |
| 14.00% | 0% | -1.37% | -2.96% | |
| Meta | 3.00% | 0% | -0.89% | -1.36% |
| OpenAI | 62.00% | 0% | -3.07% | +2.68% |
| Another organization | 12.00% | 0% | +4.56% | +2.84% |