Issues

• Ragas was independently reviewed on Hlido — scored 78/100, right of reply open

  vibrantlabsai/ragas#3102 · Filter by author ankitkapur1992-hlido opened on Nov 9, 2026

• Is RAGAS still actively maintained, or has its development stalled?

  question
  vibrantlabsai/ragas#3099 · Filter by author medjmalami opened on Nov 7, 2026
  3

• version_experiment ignores Git worktrees and can select an outer repository

  vibrantlabsai/ragas#3097 · Filter by author Elon-Jiang opened on Nov 7, 2026

• [Bug]: Reusing the same train_test_split seed changes partitions and mutates input

  vibrantlabsai/ragas#3095 · Filter by author Elon-Jiang opened on Nov 7, 2026

• [Bug]: ToolCallAccuracy drops score to 0.0 on length mismatch due to un-truncated sequence_aligned evaluation

  vibrantlabsai/ragas#3079 · Filter by author k39139215-gif opened on Nov 2, 2026
  1

• docs: Response Relevancy title doesn't match Answer Relevancy name of the metric

  bug
  vibrantlabsai/ragas#3073 · Filter by author r3v5 opened on Oct 28, 2026
  1

• Collections metrics silently evaluate stringified contexts character by character

  vibrantlabsai/ragas#3069 · Filter by author rashmi09-sys opened on Oct 26, 2026
  3

• Docs example: custom OpenAI-compatible endpoint for adversarial test generation

  vibrantlabsai/ragas#3068 · Filter by author haterfactory opened on Oct 26, 2026

• AG-UI MessagesSnapshot: str() coercion corrupts message content (None -> 'None', multimodal -> pydantic repr)

  vibrantlabsai/ragas#3060 · Filter by author contextablemark opened on Oct 11, 2026
  1

• FewShotPydanticPrompt never forwards threshold_for_examples to ExampleStore.get_examples — DemonstrationConfig.threshold silently ignored (store default 0.7 always used)

  vibrantlabsai/ragas#3056 · Filter by author BlueX888 opened on Oct 11, 2026
  1

• This project is not maintained anymore

  question
  vibrantlabsai/ragas#3053 · Filter by author kubilaycaglayan opened on Oct 9, 2026

• Integration proposal: docs page for using Ragas with hieevas (agent process & safety metrics)

  enhancement
  vibrantlabsai/ragas#3051 · Filter by author sampath-6 opened on Oct 5, 2026
  2

• New metric: structural filter-correctness for metadata-filtered retrieval

  enhancement
  vibrantlabsai/ragas#3045 · Filter by author ghubuser-dnt opened on Sep 30, 2026
  9

• answer_relevancy blocks the entire event loop via synchronous embed_query/embed_documents, stalling unrelated concurrent tasks under evaluate()

  bug
  vibrantlabsai/ragas#3040 · Filter by author ecalogero opened on Sep 27, 2026
  1

• griptape integration: ImportError raised when griptape is missing tells the user to install opik

  vibrantlabsai/ragas#3032 · Filter by author BlueX888 opened on Sep 25, 2026
  1

• llm_factory: OpenAI GPT-6 Sol/Luna/Astra on Amazon Bedrock fail with 400 because Bedrock model IDs (openai.gpt-6-sol) skip the GPT-5+ parameter mapping

  vibrantlabsai/ragas#3031 · Filter by author kimnamu opened on Sep 24, 2026
  1

• [Feature] First-class decision model abstraction for bounded metric judgments

  enhancement
  vibrantlabsai/ragas#3030 · Filter by author sanatb187 opened on Sep 23, 2026
  5

• A row that errors leaves the denominator, so the reported score rises as the system degrades

  vibrantlabsai/ragas#3028 · Filter by author shaurya416 opened on Sep 23, 2026
  3

• llm_factory: mode= is silently discarded for provider='anthropic' and provider='google'/'gemini' (new google-genai)

  vibrantlabsai/ragas#3021 · Filter by author BlueX888 opened on Sep 19, 2026
  1

• AgentGoalAccuracyWithoutReference never sets output_type, so metric.train() instruction optimization aborts with ValueError

  vibrantlabsai/ragas#3014 · Filter by author BlueX888 opened on Sep 16, 2026
  1

• Inconsistency between claims and statements in context_recall

  question
  vibrantlabsai/ragas#3013 · Filter by author dosnshcu opened on Sep 16, 2026
  2

• AG-UI MessagesSnapshot: convert_messages_snapshot drops tool call name and arguments (ToolCall(name='unknown_tool', args={}))

  vibrantlabsai/ragas#3010 · Filter by author BlueX888 opened on Sep 15, 2026

• # Question: Recommended integration approach for Node.js / TypeScript full-stack applications

  question
  vibrantlabsai/ragas#3009 · Filter by author Altria1979 opened on Sep 14, 2026

• Is this project actively maintained at this point?

  question
  vibrantlabsai/ragas#3004 · Filter by author arpieb opened on Sep 10, 2026
  3

• New metric: PII Leakage detection for RAG/agentic responses

  enhancement
  vibrantlabsai/ragas#2998 · Filter by author rajeshl8 opened on Sep 8, 2026
  1