Query Controller With Retrieval And Llm Integration

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

Unique: Implements pluggable Query Controllers that orchestrate the full RAG pipeline (embedding generation → vector search → optional reranking → LLM inference) with support for different retrieval strategies and streaming responses. Integrates with Model Gateway for both embedding and LLM access, allowing strategy and model changes through configuration.

vs others: More modular than monolithic RAG chains (allowing strategy swapping) and more transparent than black-box RAG APIs (showing retrieval results and reasoning), enabling teams to debug and optimize each pipeline stage independently.

via “llm integration and prompt orchestration”