Multi Dataset Training With Batch Sampling Strategies

via “image-question-answer triplet sampling and batching for training”

45K questions requiring reading text in images.

Unique: Sampling and batching utilities are specifically designed for OCR-VQA by supporting stratification on text-related properties (OCR token count, text density in image) and augmentation strategies that preserve text readability; enables curriculum learning where models first learn simple text reading before complex reasoning

vs others: More specialized than generic data loaders (PyTorch DataLoader) because it includes OCR-aware sampling and augmentation; more flexible than fixed batch construction because it supports dynamic stratification and curriculum learning strategies

via “multi-dataset-training-with-batch-sampling-strategies”

Embeddings, Retrieval, and Reranking

Unique: Implements configurable batch sampling strategies (round-robin, weighted, sequential) for multi-dataset training, enabling flexible dataset balancing and curriculum learning — more sophisticated than single-dataset training APIs

vs others: Enables better generalization than single-dataset training because it combines data from multiple domains, vs. training on individual datasets separately which may overfit to domain-specific patterns

via “trajectory-batch-sampling-for-training”

Dataset by nvidia. 3,55,146 downloads.

Unique: Implements curriculum learning and stratified sampling for 334K GR00T-X trajectories with native PyTorch DataLoader integration, enabling efficient distributed training without custom sampling code

vs others: More flexible than fixed-batch datasets because sampling strategy is configurable, and more efficient than random sampling because stratified and curriculum strategies reduce training variance

via “distributed batch sampling for medical imaging model training”

Dataset by mrmrx. 11,96,921 downloads.

Unique: Leverages HuggingFace Datasets' native distributed sampling with stratification support, enabling balanced batch composition across multi-GPU training without manual sharding — critical for medical imaging where class imbalance (e.g., rare pathologies) requires careful batch construction

vs others: More efficient than custom PyTorch Sampler implementations because it avoids redundant data loading on each node; more flexible than monolithic dataset files because sampling strategy can be changed without re-downloading data

via “multimodal dataset sampling and stratification for balanced model training”

Dataset by mlfoundations. 10,34,415 downloads.

Unique: Enables stratified sampling across document types and content properties at scale, allowing researchers to control training data distribution — most large datasets provide raw access without built-in stratification mechanisms

vs others: More flexible than fixed dataset splits; enables targeted evaluation on specific document categories; supports research on dataset bias and distribution effects

via “bootstrap sample generation with statistical properties preservation”

* 🏆 1998: [Gradient-based learning applied to document recognition (CNN/GTN)](https://ieeexplore.ieee.org/abstract/document/726791)

Unique: Uses sampling with replacement (rather than without-replacement partitioning) to create training set diversity while preserving original data distributions — a statistical resampling approach grounded in bootstrap theory that enables both ensemble diversity and principled uncertainty quantification through out-of-bag samples

vs others: Simpler and more theoretically justified than k-fold cross-validation for ensemble generation and preserves original data distributions better than synthetic data augmentation, but less data-efficient than without-replacement partitioning and does not address class imbalance like stratified sampling

via “efficient data sampling and subset creation”

via “data-sampling-for-annotation”