Skip to content
OpenRouterOpenRouter
© 2026 OpenRouter, Inc

Product

  • Chat
  • Rankings
  • Benchmarks
  • Apps
  • Discover
  • Models
  • Providers
  • Pricing
  • Enterprise
  • Labs

Company

  • About
  • Blog
  • Careers
    Hiring
  • Privacy
  • Terms of Service
  • Support
  • Works With OR
  • Data

Developer

  • Documentation
  • API Reference
  • Developer Platform
  • Status

Connect

  • Discord
  • GitHub
  • LinkedIn
  • X
  • YouTube

Benchmarks

Independent, reproducible measurements of the knobs you can actually set on an OpenRouter request: models, providers, search engines, and tool budgets. Every score links to the configuration, costs, and telemetry behind it.

6 benchmarks·2,464,491 task evaluations·last run Aug 11, 2026

Agents & toolsReasoningSearch

Agents & tools

BenchmarkQualityValueSpeed
  • τ²-Bench Airline

    Multi-turn service agents making tool calls under strict policy constraints.

    110 models·last run Aug 11, 2026

    81.3%
    Favicon for anthropic
    Claude Fable 5
    $0.015
    Favicon for google
    Gemma 4 31B
    1.8m
    Favicon for amazon
    Nova Micro 1.0
    Quality81.3%
    Favicon for anthropic
    Claude Fable 5
    Value$0.015
    Favicon for google
    Gemma 4 31B
    Speed1.8m
    Favicon for amazon
    Nova Micro 1.0

Reasoning

BenchmarkQualityValueSpeed
  • GPQA Diamond

    Graduate-level science questions that resist retrieval and reward careful reasoning.

    110 models·last run Aug 11, 2026

    94.3%
    Favicon for google
    Gemini 3.1 Pro Preview
    $0.021
    Favicon for openai
    GPT-5.6 Terra
    41s
    Favicon for openai
    GPT-5.6 Terra
    Quality94.3%
    Favicon for google
    Gemini 3.1 Pro Preview
    Value$0.021
    Favicon for openai
    GPT-5.6 Terra
    Speed41s
    Favicon for openai
    GPT-5.6 Terra

Search

BenchmarkQualityValueSpeed
  • BrowseComp

    Hard-to-locate facts on the live web, scored on persistent multi-step research.

    4 models·last run Aug 11, 2026

    89.0%
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    $0.99
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    1.9m
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    Quality89.0%
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    Value$0.99
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    Speed1.9m
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
  • DeepSearchQA

    Questions whose answers are lists, scored for exhaustive retrieval with no padding.

    4 models·last run Aug 11, 2026

    76.5%
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    $0.091
    Favicon for Parallel
    Parallel
    Favicon for deepseek
    DeepSeek V4 Flash 0731 · high
    1.6m
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Luna · xhigh
    Quality76.5%
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    Value$0.091
    Favicon for Parallel
    Parallel
    Favicon for deepseek
    DeepSeek V4 Flash 0731 · high
    Speed1.6m
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Luna · xhigh
  • HLE

    Humanity's Last Exam as a search benchmark: expert questions answered with live search.

    2 models·last run Aug 11, 2026

    77.4%
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    $0.16
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    48s
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    Quality77.4%
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    Value$0.16
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
    Speed48s
    Favicon for Perplexity
    Perplexity
    Favicon for anthropic
    Claude Opus 5 · high
  • WideSearch

    Fill an entire table; answer-item accuracy scores partial matches.

    4 models·last run Aug 11, 2026

    84.0%
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Sol · high
    $0.063
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Luna · xhigh
    1.9m
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Sol · high
    Quality84.0%
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Sol · high
    Value$0.063
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Luna · xhigh
    Speed1.9m
    Favicon for Perplexity
    Perplexity
    Favicon for openai
    GPT-5.6 Sol · high

For usage-based views of the same models, see the model rankings and the full model list.