-
Notifications
You must be signed in to change notification settings - Fork 484
Issues: explodinggradients/ragas
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Non-ASCII characters in faithfulness metric
bug
Something isn't working
#1022
opened Jun 10, 2024 by
mckbrchill
run_config missing
bug
Something isn't working
module-metrics
this is part of metrics module
#1021
opened Jun 7, 2024 by
Mtuthuko
AttributeError: 'LangchainLLMWrapper' object has no attribute 'agenerate_prompt'. Did you mean: 'agenerate_text'? using llm and embeddings from Huggingface
bug
Something isn't working
module-testsetgen
Module testset generation
#1020
opened Jun 7, 2024 by
Manel-Hik
RagasOutputParser exception handler should work synchronously when is_async=False
enhancement
New feature or request
#1019
opened Jun 6, 2024 by
BaptisteBtx
[R-271] Tools to estimate cost of evaluation and testset generations
#1018
opened Jun 6, 2024 by
jjmachan
[R-270] Synthetic test data generation
module-testsetgen
Module testset generation
#1016
opened Jun 5, 2024 by
jjmachan
[R-263] Roadmap - v0.2
enhancement
New feature or request
#1009
opened Jun 5, 2024 by
jjmachan
25 tasks
Synthetic Dataset Generation fail due to "ValueError: 'a' cannot be empty unless no samples are taken"
bug
Something isn't working
module-testsetgen
Module testset generation
#1006
opened Jun 4, 2024 by
antoninoLorenzo
I think it is a good idea that put all evaluate prompt templates into together.
question
Further information is requested
#1005
opened Jun 3, 2024 by
hwfancyz7k
TestsetGenerator.from_langchain Generating failed, randomly stuck at 0% to 80%.
bug
Something isn't working
module-testsetgen
Module testset generation
question
Further information is requested
#1003
opened Jun 2, 2024 by
pp6699
I've been encountering an issue where Ragas generates test cases from the initially uploaded documents, even after updating the documents and rerunning the process. It either uses the old documents or mixes them with the new ones.
bug
Something isn't working
module-testsetgen
Module testset generation
question
Further information is requested
#1002
opened Jun 1, 2024 by
AliHaider0343
Output testset when using Llama 3 8B instruct model is not proper.
question
Further information is requested
#1000
opened May 31, 2024 by
Nandakishore-Thekkadathu
Evaluation Error with Gemini/VertexAI: InvalidArgument due to Empty Text Content
bug
Something isn't working
#996
opened May 28, 2024 by
baptiste-pasquier
Using context utilization without ground truth throws error message
bug
Something isn't working
#993
opened May 28, 2024 by
dschwalm
How to save reason of each evaluation metrics?
enhancement
New feature or request
module-metrics
this is part of metrics module
#992
opened May 28, 2024 by
JinSeoung-Oh
[R-262] ImportError: llama_index must be installed to use this function. Please, install it with Something isn't working
linear
Created by Linear-GitHub Sync
module-testsetgen
Module testset generation
pip install llama_index
.
bug
#991
opened May 27, 2024 by
Prabhjot410
division by zero when computing output score
bug
Something isn't working
#989
opened May 25, 2024 by
theoden8
is_async missing in context_relevancy in ragas 0.1.8
bug
Something isn't working
module-metrics
this is part of metrics module
#986
opened May 23, 2024 by
abetatos
Previous Next
ProTip!
no:milestone will show everything without a milestone.