Columnar In Memory Storage With Apache Arrow Format

via “multimodal-data-storage-with-vector-metadata-colocalization”

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

Unique: Uses Lance columnar format (custom binary format, not Parquet) with zero-copy Arrow integration to store vectors, metadata, and raw multimodal data in a single table without data duplication. MVCC versioning is built into the storage layer, enabling atomic updates and time-travel queries without external version control systems.

vs others: More efficient than separate vector DB + object storage because colocation eliminates join overhead; more flexible than Milvus because it natively supports arbitrary metadata types and raw binary data without schema restrictions.