-
Notifications
You must be signed in to change notification settings - Fork 1
Add LlamaIndex integration example #48
Copy link
Copy link
Open
Labels
🏗️ help wantedExtra attention is neededExtra attention is needed📦 examplesApplication examples and templatesApplication examples and templates🦜 llm-appsLangChain / LlamaIndex / agent-framework integrationsLangChain / LlamaIndex / agent-framework integrations
Metadata
Metadata
Assignees
Labels
🏗️ help wantedExtra attention is neededExtra attention is needed📦 examplesApplication examples and templatesApplication examples and templates🦜 llm-appsLangChain / LlamaIndex / agent-framework integrationsLangChain / LlamaIndex / agent-framework integrations
Type
Fields
Give feedbackNo fields configured for issues without a type.
Goal
Create
examples/llamaindex-app/showing how to capture LlamaIndex query-engine runs into an AICertify contract and evaluate them.Why this matters
LlamaIndex is the second most common LLM framework for retrieval-heavy applications. RAG systems have specific compliance concerns (data leakage, hallucination, source citation) that AICertify policies can check.
Files likely involved
examples/llamaindex-app/(six-file shape)CallbackHandlersubclass underaicertify/integrations/llamaindex.pyexamples/README.mdtable entryAcceptance criteria
expected_report.mddescribes both the pass case and common RAG failure modes (hallucinated citations, leaked private docs)Help
Comment here if you want to work on this and I will help you get started. First-time contributors are welcome — open a draft PR early and I'll review.