Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

309 Open 648 Closed
309 Open 648 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

why is answer_relevancy always nan？ module-metrics this is part of metrics module question Further information is requested
#1814 opened Jan 6, 2025 by LillyChen
Is there any plan to support reason in LLMMetrics and EvaluationResult? question Further information is requested
#1813 opened Jan 6, 2025 by parkerzf
Temperature Attribute in LangchainLLMWrapper Ignored, Causing Lack of Diversity in Generated Questions for Answer Relevance bug Something isn't working
#1812 opened Jan 6, 2025 by galrettig
LCDocument import error due to TYPE_CHECKING condition bug Something isn't working
#1809 opened Jan 6, 2025 by netbuddy
expectation error bug Something isn't working question Further information is requested
#1807 opened Jan 4, 2025 by amin-kh96
1
Unable to instantiate HuggingfaceEmbeddings bug Something isn't working
#1806 opened Jan 4, 2025 by sadaisystems
Langgraph integration not working bug Something isn't working
#1802 opened Dec 30, 2024 by imvaibhav28
1
Do the scores for rubric have to be numeric and in a 1-5 range? question Further information is requested
#1800 opened Dec 27, 2024 by alexcpop
2
'StringIO' object has no attribute 'TP' bug Something isn't working
#1798 opened Dec 27, 2024 by richness
logprobs to assess the confidence of verdict prediction question Further information is requested
#1797 opened Dec 26, 2024 by Kefan-pauline
I am getting the error "TypeError(ufunc 'invert' not supported for the input types, and the inputs could not be safely coerced to any supported types according to the casting rule ''safe'')" and context_recall as 0 bug Something isn't working question Further information is requested
#1796 opened Dec 26, 2024 by tvsathish
little wrong in this page <https://docs.ragas.io/en/stable/concepts/metrics/overview/#different-types-of-metrics>? documentation Improvements or additions to documentation question Further information is requested
#1793 opened Dec 26, 2024 by earfanfan
1
Is there any demo that is compatible with ragas in langsmith? question Further information is requested
#1791 opened Dec 24, 2024 by pengxin233
How to use RagasEvaluatorChain in the latest version bug Something isn't working question Further information is requested
#1789 opened Dec 24, 2024 by pengxin233
making convert_to_ragas_messages capable of dealing with tool call AIMessages that have List as argument enhancement New feature or request
#1788 opened Dec 23, 2024 by AMMISAIDFaical
How to generate out of context questions to evaluate the hallucination of a LLM question Further information is requested
#1785 opened Dec 23, 2024 by parkerzf
Language Not Supported question Further information is requested
#1783 opened Dec 22, 2024 by yusufsyaifudin
There is some bug,Exception raised in Job[1]: ValidationError(1 validation error for ChatMessage role Input should be a valid string [type=string_type, input_value=None, input_type=NoneType] bug Something isn't working
#1782 opened Dec 21, 2024 by Terran0629
unable to apply transformation: 'headlines' property not found in this node bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1775 opened Dec 20, 2024 by Z-oo883
Answer correctness not working bug Something isn't working waiting 🤖 waiting for response. In none will close this automatically
#1774 opened Dec 19, 2024 by ekaanshkhosla
2
Factual Correctness F1, Precision and Recall at the same time. enhancement New feature or request
#1772 opened Dec 19, 2024 by Javier-Jimenez99
TypeError: 'float' object is not subscriptable when using answer_correctness metric in evaluate() bug Something isn't working module-metrics this is part of metrics module
#1771 opened Dec 19, 2024 by seroetr
2
KeyError: 0 by following the Get Started "Run ragas metrics for evaluating RAG" bug Something isn't working module-metrics this is part of metrics module
#1770 opened Dec 18, 2024 by parkerzf
1
1
the generated testset is empty bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1769 opened Dec 18, 2024 by Kevinddddddd
6
Exception raised in Job[1]: AttributeError('str' object has no attribute 'acomplete') bug Something isn't working
#1768 opened Dec 17, 2024 by waadmhj
2
ProTip! What’s not been updated in a month: updated:<2024-12-06.