Category Stratified Dialogue Sampling For Balanced Training

via “category-stratified dialogue sampling for balanced training”

200K high-quality multi-turn dialogues for instruction tuning.

Unique: Explicitly structures dataset into three semantic categories (world knowledge, creative, task assistance) with maintained stratification during curation, rather than treating all conversations as undifferentiated — this enables category-aware training strategies and prevents single-domain overfitting

vs others: More structured than generic conversation datasets (e.g., raw Reddit or web scrapes) because category labels enable curriculum learning; more flexible than single-domain datasets because it covers multiple dialogue types in one corpus

via “diverse conversation category stratification”

183K multi-turn preference comparisons for alignment.

Unique: Explicitly stratifies 183K comparisons across diverse conversation categories rather than treating preference data as a monolithic pool, enabling analysis of how model preferences vary by task type and supporting category-aware training strategies.

vs others: Provides better coverage of diverse conversation types than single-domain preference datasets, enabling more robust general-purpose alignment compared to category-specific datasets that may overfit to narrow use cases

via “multimodal dataset sampling and stratification for balanced model training”

Dataset by mlfoundations. 10,34,415 downloads.

Unique: Enables stratified sampling across document types and content properties at scale, allowing researchers to control training data distribution — most large datasets provide raw access without built-in stratification mechanisms

vs others: More flexible than fixed dataset splits; enables targeted evaluation on specific document categories; supports research on dataset bias and distribution effects