Model Training

67 TB permissively licensed code dataset across 600+ languages.

The Pile

EleutherAI's 825 GiB diverse training dataset from 22 sources.

RedPajama v2

61/100Free

30 trillion token web dataset with 40+ quality signals per document.

Polyaxon

ML lifecycle platform with distributed training on K8s.

MS COCO (Common Objects in Context)

330K images with object detection, segmentation, and captions.

MLflow

Open-source ML lifecycle platform — experiment tracking, model registry, serving, LLM tracing.

LAION-5B

5.85 billion image-text pairs foundational for image generation.

Hugging Face

61/100Free

The GitHub for AI — 500K+ models, datasets, Spaces, Inference API, hub for open-source AI.

Featureform

Virtual feature store on existing data infrastructure.

Determined AI

Deep learning training platform — distributed training, hyperparameter search, GPU scheduling.

CulturaX

6.3T token multilingual dataset across 167 languages.

ClearML

Open-source MLOps — experiment tracking, pipelines, data management, auto-logging, self-hosted.

Argilla

Open-source data curation for LLM fine-tuning and RLHF.

TriviaQA

58/100Free

95K trivia questions requiring cross-document reasoning.

ToxiGen

Microsoft's dataset for implicit toxicity detection.

Supervisely

57/100Free

Enterprise computer vision platform for teams.

StarCoderData

58/100Free

250GB curated code dataset for StarCoder training.

StarCoder Data

57/100Free

783 GB curated code dataset from 86 languages with PII redaction.