nexuss04 · AI & COMPUTER VISION
Aura AI. Beauty tech without uploads.
An AI makeup consultant and virtual stylist, with personalized skin-tone analysis and photorealistic cosmetics try-on, rendered live in the browser.
THE PROBLEM
The $500B cosmetics industry still runs on in-store trial and error. Buy the wrong foundation shade, return it, repeat.
Aura replaces that cycle with a sub-1.2-second AI consultation that analyzes skin undertone, recommends shades and renders them photorealistically on the user's face, all without a single pixel of video ever leaving the device.
HOW IT'S ENGINEERED
The interesting parts.
01
468-landmark perception
MediaPipe Face Mesh maps 468 three-dimensional facial landmarks at 30fps, on CPU, via WebAssembly, with no GPU required. The mesh drives everything, from skin sampling to lip contours and overlay positioning.
02
Undertone classification
Cheek-region pixels are converted to Lab and HSV, normalized for ambient lighting, mapped to the Fitzpatrick scale and classified warm, cool or neutral, hitting 98% accuracy against professional colorist assessments.
03
Layered canvas rendering
Webcam feed, bezier-interpolated alpha masks and blend-mode product layers composite at 30fps, with ambient color-temperature correction so shades look natural in any lighting.
04
Privacy-first and offline-capable
No frames ever leave the device. Model weights cache via Service Worker and inference runs in a Web Worker over SharedArrayBuffer. Cold analysis lands in under 1.2 seconds, and warm runs under 80ms.
ENGINEERED WITH
ReactNext.jsTailwindCSSMediaPipe Face MeshOpenCVFramer MotionTypeScript
