multi-platform video download and ingestion
Automatically downloads videos from YouTube and Bilibili platforms using dedicated API modules (backend.api.v1.youtube and backend.api.v1.bilibili) that handle platform-specific authentication, URL parsing, and video format selection. The system abstracts platform differences behind a unified video ingestion interface, storing downloaded content in a standardized format for downstream processing. Supports both direct URL input and account-based authentication for platform-specific features.
Unique: Dual-platform abstraction layer (backend.api.v1.youtube and backend.api.v1.bilibili) that normalizes platform-specific download APIs into a unified interface, handling authentication, format negotiation, and metadata extraction without requiring users to manage platform-specific logic
vs alternatives: Supports both Western (YouTube) and Chinese (Bilibili) platforms natively in a single system, whereas most video processing tools focus on YouTube-only or require separate tools per platform
llm-powered video outline extraction and content structuring
Extracts structured outlines from video content by feeding transcripts or visual keyframes to DashScope API (Alibaba's LLM service), generating hierarchical topic breakdowns with timestamps. The pipeline step (backend.pipeline.step1_outline) uses prompt engineering to convert unstructured video content into machine-readable outlines that segment the video into logical sections. This structured outline becomes the foundation for all downstream analysis, enabling timeline analysis and highlight detection.
Unique: Integrates DashScope API (Alibaba's LLM) specifically for Chinese-language video content understanding, with prompt engineering optimized for both English and Chinese transcripts, producing structured JSON outlines with timestamp precision rather than free-form summaries
vs alternatives: Purpose-built for bilingual video analysis (English + Chinese) with DashScope integration, whereas generic video summarization tools typically use OpenAI/Anthropic APIs and lack Chinese language optimization
fastapi-based rest api with project and video processing endpoints
Exposes all system functionality through a RESTful API built with FastAPI (backend/main.py and backend/api/v1/) with automatic OpenAPI documentation. Provides endpoints for project CRUD operations, video download/processing, clip retrieval, and status monitoring. Uses FastAPI's dependency injection for authentication, validation, and error handling. Implements proper HTTP status codes, error responses, and request/response schemas with Pydantic validation.
Unique: FastAPI-based REST API with automatic OpenAPI documentation and Pydantic validation, providing type-safe endpoints for all video processing operations with clear error handling and status codes
vs alternatives: FastAPI provides automatic API documentation and async support out-of-the-box, whereas Flask/Django require manual documentation and have less elegant async handling
multi-language support and internationalization infrastructure
Implements internationalization (i18n) infrastructure supporting English and Chinese languages across frontend and backend. Frontend uses i18n library for dynamic language switching with locale-specific formatting. Backend provides language-specific API responses and LLM prompts. Documentation is maintained in both languages with synchronization mechanisms. Enables global user base without requiring separate deployments.
Unique: Dual-language support (English + Chinese) built into core architecture with language-specific LLM prompts and documentation synchronization, rather than bolted-on translations
vs alternatives: Native bilingual support with optimized prompts for each language beats generic translation layers that may lose semantic meaning or cultural context
docker containerization and production deployment
Provides Docker configuration for containerized deployment of the entire system (frontend, backend, Celery workers, Redis). Includes Dockerfile for building application images, docker-compose for local development with all services, and deployment guidance for production environments. Enables consistent deployment across development, staging, and production with minimal configuration drift.
Unique: Complete Docker setup including frontend, backend, Celery workers, and Redis in single docker-compose file, enabling full-stack local development and production deployment with minimal configuration
vs alternatives: Docker-based deployment provides reproducible environments and easy scaling, whereas manual installation requires platform-specific setup and is error-prone
timeline-based video segmentation with topic detection
Analyzes structured outlines from step 1 to create fine-grained timeline segments with topic labels and temporal boundaries (backend.pipeline.step2_timeline). Uses LLM-powered analysis to detect topic transitions, segment boundaries, and content coherence across the video duration. Produces a timeline data structure that maps each second of video to its corresponding topic, enabling precise highlight detection and clip generation downstream.
Unique: Creates a dense timestamp-to-topic mapping across entire video duration using LLM analysis of outline structure, enabling sub-second precision for highlight detection, rather than coarse segment boundaries typical of rule-based segmentation
vs alternatives: Produces granular timeline data structures (second-level topic mapping) that enable precise clip boundaries, whereas traditional video editing tools rely on manual chapter markers or scene detection algorithms that lack semantic understanding
ai-driven highlight scoring and importance ranking
Scores video segments for highlight potential using LLM analysis (backend.pipeline.step3_scoring) that evaluates engagement, information density, emotional impact, and viewer interest signals. Assigns numerical scores to each timeline segment indicating likelihood of being a good highlight clip. Uses multi-dimensional scoring criteria (entertainment value, educational value, emotional peaks, etc.) to rank segments, enabling intelligent selection of top-N highlights without manual review.
Unique: Multi-dimensional LLM-based scoring that evaluates segments across entertainment, educational, emotional, and information density dimensions simultaneously, producing explainable scores rather than black-box neural network rankings
vs alternatives: Combines semantic understanding (via LLM) with explicit scoring dimensions, enabling interpretable highlight selection and customizable scoring criteria, whereas ML-based approaches (scene detection, audio analysis) lack semantic reasoning about content value
ffmpeg-based video clipping and format conversion
Generates actual video clip files from scored segments using FFmpeg operations orchestrated through backend.services.video_service. Handles video codec selection, bitrate optimization, format conversion (MP4, WebM, etc.), and audio track management. Implements efficient frame-accurate clipping by calculating exact seek positions and duration parameters, avoiding re-encoding when possible to minimize processing time. Supports batch clip generation with parallel FFmpeg processes.
Unique: Wraps FFmpeg operations in a service layer (backend.services.video_service) that abstracts codec selection, bitrate optimization, and parallel processing, with intelligent keyframe detection to minimize re-encoding overhead and support frame-accurate clipping without full video re-encoding
vs alternatives: Provides intelligent codec selection and parallel batch processing with keyframe-aware clipping, whereas naive FFmpeg usage re-encodes entire videos; more efficient than Python-only libraries (moviepy) which lack hardware acceleration
+5 more capabilities