Real Time Body Motion Capture From Video

via “pose landmark detection for body keypoint tracking”

Google's cross-platform on-device ML framework with pre-built solutions.

Unique: Provides 33-point full-body skeleton with 3D coordinate estimation (including depth via monocular estimation) and per-landmark visibility scores, optimized for on-device inference on mobile and web platforms; uses a single-stage neural network approach rather than multi-stage pipelines.

vs others: Faster and more mobile-friendly than OpenPose or MediaPipe's legacy Pose solution, includes 3D coordinate estimation without requiring depth cameras unlike some alternatives, but limited to single-person pose and requires full-body visibility unlike multi-person pose systems.

via “act-two performance capture and motion extraction”

AI video generation — Gen-3 Alpha, text/image to video, motion controls, professional filmmaking.

Unique: Act-Two is Runway's proprietary motion capture model, enabling mocap-free motion extraction from video; suggests computer vision approach to skeletal tracking rather than hardware-based capture, but output formats and re-targeting pipeline are undocumented

vs others: Eliminates need for mocap suits or specialized hardware; video-based approach is more accessible than traditional mocap, but accuracy and output quality compared to professional mocap systems unknown

via “video-to-video facial motion transfer”

LivePortrait — AI demo on HuggingFace

Unique: Decouples motion representation from identity through a learned latent space where motion vectors are identity-agnostic, enabling transfer across faces with different morphologies without explicit face alignment or 3D model fitting

vs others: Faster than traditional motion capture workflows and more flexible than keyframe-based animation tools because it learns motion patterns end-to-end rather than requiring manual annotation or specialized hardware

via “ai-driven character animation from live-action footage”

Effortlessly animate, light, and compose CG characters into live scenes.

Unique: Uses markerless AI-based pose inference trained on large-scale video datasets to extract animation data directly from uncontrolled live-action footage, eliminating the need for physical mocap markers, suits, or dedicated capture volumes. Implements real-time skeletal tracking with automatic rig retargeting.

vs others: Eliminates expensive mocap hardware and studio setup costs compared to traditional optical/inertial motion capture systems while maintaining broadcast-quality animation output

via “real-time body motion capture from video”

via “real-time human pose estimation from video”

via “body-pose-estimation-from-video”

via “markerless body pose estimation”

via “real-time single-person skeletal pose estimation from video stream”

Unique: Hardware-agnostic approach eliminates dependency on OptiTrack, Vicon, or Kinect systems by running inference on standard webcams; freemium tier removes upfront hardware investment barrier that traditionally gates motion capture access to well-funded studios

vs others: Dramatically cheaper deployment than traditional mocap (no marker suits, cameras, or calibration) but lacks the sub-millimeter accuracy and multi-person tracking of enterprise systems like OptiTrack

via “video-to-skeleton-tracking”

via “full-body motion reenactment”

via “2d-to-3d video motion capture with multi-person skeletal tracking”

Unique: Eliminates hardware barrier to motion capture by using standard webcam/video input instead of marker-based systems or depth sensors; processes video server-side and outputs portable FBX format compatible with any 3D animation software, making professional mocap accessible to solo developers and small teams without $10k+ equipment investment

vs others: Dramatically cheaper than professional mocap studios ($500-2000/day) while maintaining acceptable accuracy for game animation; more accessible than marker-based systems (Vicon, OptiTrack) that require specialized hardware and trained operators, though with lower precision for broadcast-quality animation

via “webcam-realtime-motion-capture”

via “video-to-3d-animation-conversion”

via “ai-driven character motion capture and animation”