Skip to main content
Drop a repoSign up
NEWvicrodh/qbzjust droppedNEWkowalski-ptr/compass-before-compactjust droppedNEWlastmile-ai/mcp-agentjust droppedREPOxai-org/grok-build+1827 stars 24hREPOmsitarzewski/agency-agents+566 stars 24hREPOsafishamsi/graphify+504 stars 24hREPOstablyai/orca+492 stars 24hREPOjamiepine/voicebox+436 stars 24hNEWvicrodh/qbzjust droppedNEWkowalski-ptr/compass-before-compactjust droppedNEWlastmile-ai/mcp-agentjust droppedREPOxai-org/grok-build+1827 stars 24hREPOmsitarzewski/agency-agents+566 stars 24hREPOsafishamsi/graphify+504 stars 24hREPOstablyai/orca+492 stars 24hREPOjamiepine/voicebox+436 stars 24h
confident-ai/deepevalpublicPythongithub.com/confident-ai/deepeval
confident-ai avatar

deepeval

The LLM Evaluation Framework

EVALUATION METRICSEVALUATION FRAMEWORKLLM EVALUATIONLLM EVALUATION FRAMEWORKLLM EVALUATION METRICSPYTHONTRENDING #175

// OWNER · confident-ai · REPO SNAPSHOT

github.com/confident-ai

confident-ai

The LLM Evaluation Framework

STARS16,936+158 · 7d
FORKS1,675+0 · 7d
CONTRIBUTORS0maintainer graph thin
OPEN ISSUES · PRS223· 0 
LICENSEno license file
LANGUAGEPython 
FOUNDED
LOCATION
MEMBERS
PUBLIC REPOS
TOTAL STARS
FOCUS
FUNDING

//STAR HISTORY · 12M

+1,933 all-time-window
Stars · cumulative16,933 · today
//WHY IT'S TRENDING· expert verdict · 82% confidence

open-source LLM evaluation framework with synthetic data generation and metrics

deepeval ranks #2 on dev.to but is absent from GitHub, HN, X, Reddit, and Bluesky signals. A single-platform spike with no cross-source confirmation.

Why now: Recent dev.to tutorial or company publishing likely triggered algorithmic visibility on that platform alone.

  • Only dev.to (rank 2, score 21) shows any signal; all other 7 weighted sources are null
  • externalRank=45 vs oursRank=44 indicates no lead time; both pipelines essentially missed it
  • Source count: 1/9 weighted sources active; 183 of 200 pool entries are single_source
  • dev.to pool has only 41 total rows vs GitHub's 1000, making rank 2 statistically fragile

Considerations: dev.to is a low-volume, SEO-heavy platform where a single popular tutorial or company blog post can spike rankings without organic developer uptake. No GitHub velocity, no HN discussion, no social buzz means this is likely content marketing surfacing, not grassroots adoption.

EMERGING SIGNAL · Ignore: Revisit only if GitHub stars, HN, or X signals emerge within 14 days.

Sources: dev.to search: confident-ai/deepeval

↻ refreshed 28m ago· next sync in 37m· sourced from 1 channel · 0 mentions / 24h

Methodology: synthesized from this project's own documentation, live GitHub data, third-party coverage, and multi-platform signal convergence — by AISO.tools.

FAQ · answers from the data spine

What is confident-ai/deepeval?
The LLM Evaluation Framework
Who maintains deepeval?
Maintained by confident-ai (the owner) on GitHub.
What language is deepeval written in?
Primarily Python.
When was deepeval created? When was the last update?
Created August 10, 2023 · last commit July 16, 2026.
How do I install deepeval?
Clone the repo:
git clone https://github.com/confident-ai/deepeval.git
Then follow the README in the cloned directory.
Is deepeval actively maintained?
stalled — no commits for an extended period

//COMMENTS · 0

live thread · operators only

Sign in to join the discussion

Be the first to comment.
Created
Updated
Last commit