Skip to main content
⌘K
Drop a repoSign up
NEWvicrodh/qbzjust droppedNEWkowalski-ptr/compass-before-compactjust droppedNEWlastmile-ai/mcp-agentjust droppedREPOstablyai/orca+228 stars 24hREPOdiegosouzapw/OmniRoute+151 stars 24hREPOpbakaus/impeccable+134 stars 24hREPOkoala73/worldmonitor+122 stars 24hREPOsafishamsi/graphify+108 stars 24hNEWvicrodh/qbzjust droppedNEWkowalski-ptr/compass-before-compactjust droppedNEWlastmile-ai/mcp-agentjust droppedREPOstablyai/orca+228 stars 24hREPOdiegosouzapw/OmniRoute+151 stars 24hREPOpbakaus/impeccable+134 stars 24hREPOkoala73/worldmonitor+122 stars 24hREPOsafishamsi/graphify+108 stars 24h
openai/evalspublicPythongithub.com/openai/evals
openai avatar

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

PYTHONAI MLDECLINING VELOCITYTRENDING #2648
Comments0CompareSet alertExportRSSVisit repo

// OWNER · openai · REPO SNAPSHOT

github.com/openai

openai

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

GitHubopenai
STARS19,021+64 · 7d
FORKS3,034+0 · 7d
CONTRIBUTORS0maintainer graph thin
OPEN ISSUES · PRS125· 0 
LICENSE—no license file
LANGUAGEPython 
FOUNDED—
LOCATION—
MEMBERS—
PUBLIC REPOS—
TOTAL STARS—
FOCUS—
FUNDING—

//STAR HISTORY · 12M

+359 all-time-window
Stars · cumulative19,019 · today
//WHY IT'S TRENDING· narrative synthesis · medium confidence

openai/evals is sitting at #2648 on the trending leaderboard with a pulse of 2/100 with no cross-source channels firing yet — GitHub-stars-only signal so far.

The 7-day star delta is +64 (+0.3%) against a base of 19,021, so the headline number is category momentum more than a personal breakout. What's actually moving is the Python ai-ml space.

Watch-outs: no tagged release on record (treat as pre-stable).

↻ refreshed 18m ago· next sync in 47m· sourced from 0 channels · 0 mentions / 24h

// RELATED REPOS · CROSS-SOURCE OVERLAP

5 detected · 30d window
#01
NousResearch/hermes-agent
ai-agentsclaude-codellm-infraShared tag: ai-agents.
CO-MENTIONS · 30D (18 total)
108
★ 221k
32
last · 1h ago
#02
cheahjs/free-llm-api-resources
claude-codellm-infraShared tag: claude-code.
CO-MENTIONS · 30D (2 total)
2
★ 28.3k
25
last · 1d ago
#03
vllm-project/vllm
llm-infraShared tag: llm-infra.
CO-MENTIONS · 30D (2 total)
2
★ 87.2k
25
last · 1h ago
#04
Significant-Gravitas/AutoGPT
ai-agentsclaude-codellm-infraShared tag: ai-agents.
CO-MENTIONS · 30D (0 total)
0
★ 186k
24
last · 9h ago
#05
opensquilla/opensquilla
agent-memoryagent-skillsai-agentsShared tag: agent-memory.
CO-MENTIONS · 30D (0 total)
0
★ 6.4k
24
last · 8h ago

▌ FAQ · answers from the data spine

What is openai/evals?
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Who maintains evals?
Maintained by openai (the owner) on GitHub.
What language is evals written in?
Primarily Python.
When was evals created? When was the last update?
Created January 23, 2023 · last commit April 14, 2026.
How do I install evals?
Clone the repo:
git clone https://github.com/openai/evals.git
Then follow the README in the cloned directory.
Is evals actively maintained?
stalled — no commits for an extended period

//COMMENTS · 0

live thread · operators only

Sign in to join the discussion

Be the first to comment.
Created
Updated
Last commit
Repositoryopenai/evals