Smart glasses that tell me when to stop pouringRepository30/100 via “real-time ar display overlay rendering on smart glasses”
I've been experimenting with a more proactive AI interface for the physical world.This project is a drink-making assistant for smart glasses. It looks at the ingredients, selects a recipe, shows the steps, and guides me in real time based on what it sees. The behavior I wanted most was simple:
Unique: Synchronizes overlay rendering with video capture frame rate using hardware-level vsync, ensuring overlays appear exactly where the user is looking without temporal misalignment. Uses Rokid's native rendering pipeline rather than generic graphics libraries.
vs others: Achieves lower latency than software-based overlay composition (OpenCV, PIL) because it uses GPU-accelerated rendering on the glasses' native hardware, reducing overlay-to-display latency from 50-100ms to <16ms