pdf document ingestion with vector embedding pipeline
Processes uploaded PDF files through a LangGraph-orchestrated ingestion graph that extracts text, chunks documents, generates vector embeddings via OpenAI's embedding API, and persists them to Supabase's pgvector-enabled PostgreSQL database. Uses LangChain's document loaders and text splitters to handle variable PDF structures and sizes, with configurable chunking strategies to balance retrieval granularity and context window efficiency.
Unique: Uses LangGraph state machines to orchestrate multi-step ingestion (PDF load → text split → embed → store) with explicit state transitions, enabling observable, debuggable document processing pipelines. Integrates Supabase pgvector natively rather than requiring separate vector DB infrastructure, reducing deployment complexity.
vs alternatives: Simpler deployment than Pinecone/Weaviate-based RAG stacks because it co-locates vectors in PostgreSQL; more observable than simple LangChain chains because LangGraph surfaces intermediate states for monitoring and error recovery.
semantic document retrieval with query routing
Implements a LangGraph-based retrieval graph that accepts natural language queries, routes them through a decision node (using an LLM to determine if document context is needed), performs vector similarity search against embedded PDFs when relevant, and returns ranked results with source attribution. Uses cosine similarity on pgvector embeddings and implements a configurable similarity threshold to filter low-confidence matches, reducing hallucination by grounding responses in actual document content.
Unique: Implements explicit query routing as a LangGraph node rather than always retrieving — this reduces unnecessary vector DB queries and latency for general-knowledge questions. Routes via LLM decision logic (not keyword heuristics), enabling nuanced routing for complex queries.
vs alternatives: More efficient than always-retrieve RAG patterns because it skips vector search for non-document queries; more flexible than rule-based routing because LLM routing adapts to query semantics rather than fixed keywords.
document metadata extraction and indexing
Extracts and indexes document metadata (filename, upload timestamp, page count, chunk count) alongside embeddings, enabling filtering and sorting of search results by document properties. Stores metadata as JSON in the pgvector table, allowing SQL queries to filter by document attributes before or after similarity search. Implements automatic metadata generation during ingestion, with optional user-provided metadata (tags, categories) for custom filtering.
Unique: Stores metadata as JSON alongside vectors in pgvector, enabling SQL queries that combine vector similarity with metadata filtering in a single statement. Automatic metadata extraction during ingestion reduces manual effort.
vs alternatives: More flexible than fixed metadata schemas because JSON allows arbitrary properties; more efficient than post-filtering results because metadata filtering happens in the database.
error handling and recovery with graceful degradation
Implements error boundaries at multiple layers (API routes, React components, LangGraph nodes) to catch and handle failures gracefully. API routes return meaningful HTTP status codes and error messages; React components display error UI without crashing; LangGraph nodes implement retry logic and fallback paths. Uses try-catch blocks and error callbacks to transform backend exceptions into user-friendly messages, preventing technical errors from reaching end users.
Unique: Implements error handling at multiple layers (API, React, LangGraph) with consistent error transformation, ensuring errors are caught and handled at the appropriate level. Uses error boundaries to prevent UI crashes while maintaining error visibility for debugging.
vs alternatives: More robust than unhandled errors because errors are caught at multiple layers; more user-friendly than technical error messages because errors are transformed into plain language.
monorepo structure with turborepo build orchestration
Organizes the application as a monorepo with separate frontend (Next.js) and backend (Node.js/LangGraph) workspaces, coordinated by Turborepo for efficient builds and dependency management. Turborepo caches build artifacts and skips rebuilds for unchanged packages, reducing build time. Shared types and utilities are extracted to a common package, enabling type-safe communication between frontend and backend without duplication.
Unique: Uses Turborepo to orchestrate builds across multiple workspaces with intelligent caching, avoiding redundant builds when packages haven't changed. Shared types package enables type-safe communication between frontend and backend.
vs alternatives: Faster builds than separate repositories because Turborepo caches unchanged packages; easier type sharing than separate repos because types live in a shared package.
streaming response generation with source attribution
Generates LLM responses in real-time using OpenAI's streaming API, with each token streamed to the frontend via Server-Sent Events (SSE). Maintains a parallel metadata stream that tracks which source documents contributed to each response section, enabling inline source attribution in the UI. Uses LangChain's streaming callbacks to intercept token events and map them back to retrieved document chunks, providing transparent provenance for every answer.
Unique: Implements dual-stream architecture where response tokens and source metadata are streamed in parallel via SSE, allowing the UI to render both content and attribution simultaneously. Uses LangChain's streaming callbacks to intercept generation events and correlate them with retrieval context, rather than post-processing the final response.
vs alternatives: Provides real-time feedback with source attribution in a single stream, whereas naive approaches either stream without sources or batch-generate then attribute; more transparent than systems that hide source mapping from the user.
multi-turn conversation state management with context window optimization
Maintains conversation history in frontend state (React hooks) and backend session storage, with automatic context window management that truncates or summarizes older messages to fit within the LLM's token limit. Uses a sliding window strategy where recent messages are always included, and older messages are progressively dropped or compressed based on token count. Implements conversation reset and context clearing to allow users to start fresh without losing document embeddings.
Unique: Implements sliding window context management at the application level (not delegated to LLM) using explicit token counting, allowing fine-grained control over what context is preserved. Separates conversation state (frontend) from document embeddings (backend), enabling independent lifecycle management.
vs alternatives: More efficient than always-including-full-history approaches because it actively manages token budget; more transparent than black-box context managers because token decisions are visible and tunable.
langgraph state machine orchestration for multi-step workflows
Orchestrates complex document processing and query workflows using LangGraph's directed acyclic graph (DAG) execution model, where each node represents a discrete step (PDF load, chunk, embed, retrieve, generate) and edges define control flow. Implements conditional routing nodes that branch execution based on query type or document availability, with built-in error handling and state persistence. Uses LangGraph's compiled graph execution to optimize performance and enable step-by-step debugging.
Unique: Uses LangGraph's compiled graph execution model to represent workflows as explicit DAGs rather than imperative code, enabling conditional routing, state inspection, and step-by-step execution. Separates workflow definition from execution, allowing the same graph to be used in different contexts (API, CLI, batch).
vs alternatives: More transparent and debuggable than nested function calls because each step is a named node with visible state; more flexible than linear pipelines because conditional routing is first-class, not bolted on.
+5 more capabilities