Batch Data Import And Preprocessing

via “asynchronous data import with format auto-detection and validation”

Open-source text annotation for NLP tasks.

Unique: Uses Celery task queue with format auto-detection via file extension and content sniffing, combined with Django's bulk_create() for batch inserts — imports are tracked by task ID, allowing users to check progress and retrieve error logs without blocking the UI

vs others: More scalable than synchronous imports in Prodigy but less sophisticated than Label Studio's streaming parser; better for teams with large datasets and limited patience for blocking uploads