Skip to content

Pull requests: confident-ai/deepeval

New pull request New
41 Open 1,839 Closed
41 Open 1,839 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Openai embedding tracing support
#2575 opened Mar 26, 2026 by A-Vamshi Loading…
1
Fix a couple type annotations in base_metric.py
#2574 opened Mar 25, 2026 by tbeadle Loading…
1
feat: add penalize_ambiguous_claims to AnswerRelevancyMetric
#2573 opened Mar 25, 2026 by Krishnachaitanyakc Loading…
3 tasks
1
1
fix(gemini): fix log_probs detection, temperature guard, and add Gemini 3.x models
#2572 opened Mar 23, 2026 by GerardoYalo Loading…
1
Add test_case_id support to ConfidentSpanExporter
#2570 opened Mar 22, 2026 by AlexMaggioni Loading…
1 task done
2
fix(ragas): update capture_metric_type call for new telemetry signature
#2568 opened Mar 22, 2026 by sachinML Loading…
1
2
Add GoodMem integration for memory-powered retrieval
#2566 opened Mar 19, 2026 by bassammalik Loading…
4 of 5 tasks
3
Fix: Parse CSV Single-Turn Golden ToolCalls as JSON objects
#2565 opened Mar 19, 2026 by seankelley-dt Loading…
1
3
fix: include tool and trace state in evaluation cache keys
#2561 opened Mar 19, 2026 by aerosta Loading…
1
fix: preserve metric snapshots when async metric tasks fail in indicator
#2560 opened Mar 18, 2026 by aerosta Loading…
1
Fix NoneType crash in trimAndLoadJson when LLM returns None
#2558 opened Mar 18, 2026 by joaquinhuigomez Loading…
7
feat: add native Groq model integration for high-speed evaluations
#2556 opened Mar 17, 2026 by Jayachander123 Loading…
4 tasks done
15
Add tags field to Golden and ConversationalGolden
#2543 opened Mar 9, 2026 by brian-romain Loading…
2
fix: avoid division by zero in GEval score normalization
#2541 opened Mar 8, 2026 by aerosta Loading…
1
fix: prevent double-wrapping in KnowledgeRetentionMetric extraction
#2536 opened Mar 6, 2026 by koriyoshi2041 Loading…
1 task done
1
1
Default deepeval to use claude model
#2525 opened Mar 3, 2026 by A-Vamshi Loading…
2
feat: add user-defined prompt_builder to Synthesizer
#2519 opened Mar 1, 2026 by rahulmansharamani14 Loading…
1
3
Add MLLMDocument to support PDF inputs in LLMTestCase
#2516 opened Feb 28, 2026 by Fizza-Mukhtar Loading…
1
2
fix: actual_output and tools_called are None when using ConfidentInstrumentationSettings
#2515 opened Feb 27, 2026 by Fizza-Mukhtar Loading…
1
2
Add upload method to DAG metrics
#2446 opened Jan 21, 2026 by A-Vamshi Loading…
2
test(docs): add end to end evaluation doc tests
#2442 opened Jan 19, 2026 by BloggerBust Loading…
2
Improved JSON Parsing Error Handling
#2440 opened Jan 17, 2026 by yzhao244 Loading…
2
Replaced Print Statements with Proper Logging
#2439 opened Jan 17, 2026 by yzhao244 Loading…
2
tests(docs): add component-level eval tracing and dataset IO tests
#2433 opened Jan 14, 2026 by BloggerBust Loading…
2
feat: add DeepEval + E2B sandbox SWE evaluation pipeline example
#2430 opened Jan 12, 2026 by Ayush7614 Loading…
3
ProTip! Mix and match filters to narrow down what you’re looking for.