How It Works

Learn how your votes power transparent AI progress

Ask a Question

Type in your prompt or question to the open arena. The data is collected to support fair, public evaluations.

Compare Answers

You'll be served 2 anonymous models. Dig into the responses and decide which answer best fits your needs.

Vote for the Best

Choose your preferred response. Your vote helps shape the public AI leaderboards.

Discover and Repeat

After voting, the model identities are revealed. Keep exploring to help improve AI in this open, community-powered space.

Transparency & Privacy

Learn more about our policies, and how the community impacts the leaderboards. Since March 2024, we've helped test proprietary and open source models from major labs and small teams. This includes pre-release models, meaning the community's feedback directly influences how new AI models are developed, refined, and released.

Open Research

Learn more about our open data sets and research papers. Beyond the leaderboards, we’re actively developing new research, and analyses to help everyone better understand human preference. We release up to 20% of prompt and vote data openly to the public.