What happens when I vote in a model battle?

When you vote, you're directly influencing the public leaderboard rankings. Your choice updates each model's score using the Elo rating system, a method originally developed for ranking players in competitive games like chess. We use Elo because it's well-suited for pairwise comparisons, allowing us to update model scores incrementally based on real user preferences.

Are the models truly anonymous? When are their names revealed?

Yes, the models remain anonymous during voting to ensure fairness and eliminate potential bias. The model names are revealed immediately after you cast your vote, so you can discover which model you preferred. Note: Only votes made while the models are anonymous count toward official rankings; any votes cast after model identities are revealed will not impact leaderboard standings.

Can I submit multiple prompts or votes?

Absolutely! You're welcome to submit as many prompts and votes as you'd like. Every vote helps improve the accuracy and diversity of the leaderboard, making it more reflective of real-world model performance.

A few things to keep in mind:

Is my prompt data publicly visible?

Your conversations may be shared to support our community, improve our service, and advance the development of reliable AI. This includes posting conversations publicly online. Any data that we share is always anonymous and never linked to you. We never share any personal information, just the conversation and votes.

How is my feedback used to rank AI models?

Your votes directly shape the model rankings through the Elo rating system, a method originally developed for ranking players in competitive games like chess. We use Elo because it's well-suited for pairwise comparisons, allowing us to update model scores incrementally based on real user preferences. The more you vote, the more reliable and representative the leaderboard becomes. This makes LMArena leaderboards grounded in community judgment, not static benchmarks.

What steps do you take to protect my privacy?

We take user privacy seriously. All prompts and votes are anonymous and not connected to personally identifiable information. Additionally, individual conversations are never publicly shared beyond prompt text and model responses, ensuring your identity remains protected.

Why do you collect user prompts openly?

We openly collect prompts to maintain transparency, reproducibility, and trustworthiness of the evaluations. Open data helps the community independently verify model performance and ensures our benchmarks reflect authentic, real-world scenarios.

Can I access the evaluation data for research?

Yes! We share a portion of our anonymized voting data with the research community to support open science and reproducibility. While we don't release full conversation logs for privacy and methodological reasons, the available data includes prompt text, voting outcomes, and model pairings. You can explore our datasets with Arena Explorer or directly on HuggingFace and reach out if you're interested in collaborations or deeper access.

Who else participates in these evaluations?

LMArena is powered by a diverse global community, from AI enthusiasts and students to researchers, developers, and everyday users. Everyone is welcome to this open space, because we believe the best AI evaluations reflect real-world diversity and lived experience, not just expert opinion.

How does LMArena sustain itself financially?

While LMArena began as a research initiative, we have graduated into a platform. We are currently supported through volunteers, grants and sponsors across UC Berkeley SkyLab, a16z, Sequoia, Fireworks AI, Together AI, RunPod, Anyscale, Replicate, Fal AI, Hyperbolic, Kaggle, MBZUAI, and HuggingFace. Learn more on our About Us page.