Training Compute-Optimal Large Language Models (Chinchilla) vs SavirOS

Determines the mathematically optimal allocation of training compute budget between model parameters and training tokens using empirical scaling laws derived from training runs across multiple model sizes. The approach fits power-law relationships to observed loss curves, then solves for the compute-optimal ratio where both parameters and tokens scale equally with total compute budget (N ≈ C/6L, D ≈ 20C/L where C is compute budget). This differs from prior Kaplan scaling laws which suggested undertrained models; Chinchilla shows equal parameter-token scaling is optimal.

Unique: Empirically derives compute-optimal scaling laws through systematic training of models from 70M to 540B parameters, discovering that parameter count and token count should scale equally with compute budget (contrary to prior Kaplan et al. scaling laws which suggested undertrained models were optimal). Uses power-law fitting to loss curves across multiple scales to establish generalizable relationships.

vs alternatives: More compute-efficient than prior Kaplan scaling laws by ~20% through equal parameter-token scaling; provides empirically-grounded recommendations rather than theoretical extrapolations, making it more reliable for practical training budget allocation decisions

Predicts training loss for unseen model sizes by fitting power-law functions (L(N,D) = aN^α + bD^β + E) to loss measurements from trained models at multiple scales, then interpolating or extrapolating to new parameter/token combinations. The model captures how loss decreases with both parameter count and data size, enabling loss prediction without retraining. Chinchilla's key finding is that optimal loss follows L_opt(C) = E + (C/6L)^-α where both exponents are approximately -0.07.

Unique: Fits bidirectional power-law scaling laws (loss as function of both parameters AND tokens) rather than unidirectional extrapolation; discovers that optimal loss follows a specific compute-dependent curve where both parameter and token exponents are nearly identical (~-0.07), enabling unified compute-optimal recommendations.

vs alternatives: More accurate than prior Kaplan scaling laws for predicting loss at new scales because it accounts for both parameter and token scaling simultaneously; enables loss prediction without retraining, saving weeks of compute compared to empirical validation

Given a fixed training compute budget (measured in FLOPs), solves for the optimal split between model parameters (N) and training tokens (D) by applying the derived scaling law relationships. The solver uses the constraint that compute C ≈ 6ND (accounting for forward and backward passes) and the empirical finding that optimal allocation has N ≈ C/6L and D ≈ 20C/L, where L is the sequence length. This produces a deterministic recommendation for model size and dataset size given compute budget.

Unique: Solves the parameter-token allocation problem as a constrained optimization using empirically-derived scaling laws, producing deterministic recommendations rather than heuristics. The key insight is that equal scaling of parameters and tokens (N ∝ D ∝ √C) is optimal, contrary to prior assumptions of undertrained models.

vs alternatives: Provides data-driven allocation recommendations vs rule-of-thumb approaches; accounts for both parameter and token scaling simultaneously rather than treating them independently, resulting in ~20% better compute efficiency than prior Kaplan-based approaches

Trains multiple model instances at different scales (70M, 400M, 1B, 3B, 7B, 13B, 70B parameters) with varying token counts, measures training loss curves, and fits power-law functions to the observed data. The fitting process uses least-squares regression on log-log plots to extract scaling exponents and coefficients, then validates the fit by comparing predicted vs observed loss on held-out model sizes. This creates an empirical foundation for all downstream scaling law predictions and recommendations.

Unique: Conducts systematic empirical training across 6+ model scales from 70M to 540B parameters with multiple token counts per scale, fitting bidirectional power-law relationships rather than relying on theoretical extrapolation. Validates fits on held-out scales to ensure generalization.

vs alternatives: More comprehensive than prior Kaplan et al. scaling law study by covering larger model sizes (up to 540B vs 1.3B) and testing both parameter and token scaling simultaneously; provides empirically-grounded exponents rather than theoretical predictions

Measures and compares training efficiency metrics (loss per compute unit, convergence speed, sample efficiency) across different model sizes and token counts. Efficiency is quantified as the loss achieved per unit of compute (FLOPs), enabling direct comparison of whether larger models or more tokens provide better returns on compute investment. The benchmarking reveals that compute-optimal allocation (equal parameter-token scaling) achieves better efficiency than either parameter-heavy or token-heavy alternatives.

Unique: Systematically benchmarks training efficiency across a wide range of model sizes (70M to 540B) and token counts, revealing that compute-optimal allocation (N ≈ D) achieves ~20% better efficiency than undertrained or overtrained alternatives. Provides empirical efficiency curves rather than theoretical predictions.

vs alternatives: More comprehensive efficiency analysis than prior work by testing both parameter and token scaling; reveals that equal scaling is optimal, contradicting prior assumptions of undertrained models being more efficient

SavirOS is an AI-powered Relationship Operating System that enhances meeting preparation by auto-generating intelligence briefs, tracking promises, and compiling relationship memory, ensuring users are always prepared and informed for their meetings.

Unique: SavirOS uniquely compounds relationship intelligence across all interactions, making it smarter with each meeting unlike competitors that treat meetings in isolation.

vs alternatives: SavirOS offers a more integrated and intelligent approach to meeting preparation compared to traditional tools that focus solely on transcription or note-taking.

SavirAI is a triage-RAG agent that answers questions about relationships, schedules actions, drafts emails, generates documents, and manages contacts — all through natural conversation. 84 tools across 7 agents: platform, calendar, relationship, pre-meeting, post-meeting, communication, creation. Autonomy policy gates sensitive actions (email sending, rescheduling) behind user confirmation.

Seven AI-powered generators for meeting-related communications: icebreaker conversation starters, meeting agenda generator, follow-up email drafts, email subject line optimizer, meeting decline message writer, introduction email generator, and out-of-office reply creator. All free, no signup required.

Automatically enriches contacts with LinkedIn profile data (Proxycurl), company intelligence (Hunter.io), recent news (NewsData.io), and web search (Tavily). Creates comprehensive contact profiles with career history, company details, mutual connections, and recent activity.

Four utility tools: QR code generator (URL, WiFi, vCard, text — PNG/SVG export), browser-based image compressor (JPEG/PNG/WebP, no upload), JSON formatter/validator with tree view, and file sharing (up to 50MB, shareable links). All free, no signup, privacy-first.

Four free lookup tools: reverse caller ID (global, spam detection, confidence scoring), professional email finder (Hunter.io verification), person lookup (career history, talking points via Proxycurl/Tavily), and company lookup (industry, funding, team size, news, social links).

Five meeting utilities: real-time meeting timer with agenda tracking, meeting link decoder (extracts ID/passcode from Zoom/Teams/Meet URLs), instant meeting link generator, WhatsApp link builder with prefilled messages, and downloadable .ics calendar event creator.

Auto-detects ended meetings (every 3 minutes). Processes transcripts from Recall.ai, Fireflies.ai, or user-pasted notes. Extracts structured summary, key points, decisions (with rationale and decision maker), and commitments. Builds episodic memory records. Extracts individual facts and consolidates into per-contact intelligence profiles.