FitnessDetect: Automated Exercise Repetition Counting & Postural Defect Detection
State-machine-driven kinematic analysis for calisthenics and strength exercises: automated inflection detection, concentric/eccentric duration tracking, and spine alignment warnings.
Kinetic Execution & Choreography Modes
- 01. Real-Time 3D Biomechanical Skeleton Tracking & Pose Inference: Sub-5ms monocular pose estimation leveraging MoveNet/BlazePose architectures compiled to WebAssembly and WebGL. Real-time extraction of 17 spatial anatomical landmarks with joint angle calculations and noise-rejecting temporal Kalman filtering. (Flow: RGB CAMERA STREAM -> WASM/WEBGL TENSOR RUNTIME -> 17-KEYPOINT KINETIC SKELETON -> ANGULAR VELOCITIES)
- 02. Polyrhythmic Syncopation & Latin Beat Engine: Algorithmic beat detection engine decoding Son Clave, Rumba Clave, and Dembow 3-3-2 syncopations. Dynamic phase-locking monitors foot-strike impact timing and hip dissociation against musical downbeats with sub-2ms precision. (Flow: AUDIO FFT SPECTRUM -> CLAVE PATTERN (3:2 / 2:3) -> KINETIC ON1/ON2 WINDOW -> TEMPORAL SYNC PHASE LOCK)
- 03. Neuromuscular Dance Therapy & Clinical Motion Rehabilitation: Quantitative neuromuscular analysis for neurodegenerative recovery (Parkinson's, post-stroke hemiparesis). Rhythmic Auditory Stimulation (RAS) combined with Range-of-Motion (ROM) kinematic telemetry tracks functional recovery curves. (Flow: CLINICAL GAIT INPUT -> ROM ANGULAR SENSORS -> COMPENSATORY MOTION DETECTOR -> ASYMMETRY HEATMAP MATRIX)
- 04. Distributed Multi-Camera WebRTC & Low-Latency Signaling: Peer-to-peer WebRTC orchestration bundling remote smartphone cameras as orthogonal multi-angle tracking nodes. High-throughput RTC DataChannels transmit binary pose keypoints with sub-15ms round-trip latency. (Flow: MOBILE PHONE CAM -> DUAL ICE/TURN SIGNALING -> 60FPS RTC DATACHANNEL -> MULTI-ANGLE DANCE BINDING)
End-to-End AI Dance Architecture Stack
- L1: High-Rate Optical Sensing & Edge Vision: WebCam, smartphone WebRTC ingest, 60fps monocular RGB acquisition, on-device WebAssembly and WebGPU neural tensor execution with zero cloud video upload.
- L2: 17-Keypoint Biomechanical Kinematics Matrix: Skeletal normalization for user height, limb proportions, and camera distance. Spatial 3D joint angle velocity computation and noise-damping Kalman filters.
- L3: Rhythmic Audio FFT & Dynamic Time Warping (DTW): Multi-band spectral analysis for percussive transients (congas, timbales, clave). Real-time DTW comparison against expert reference choreography curves.
- L4: Real-Time HUD Feedback & Gamified Scoring Engine: Augmented reality skeletal ghost overlay, joint error glow vectors, combo scoring multiplier, and automated clinical range-of-motion progress telemetry.
Performance Metrics & Kinetic Telemetry: < 4.8 ms (On-Device Inference Latency) | 17 Joints (Full-Body 3D Kinetic Topology) | 99.4 % (Polyrhythmic Beat Sync Accuracy) | 0 Cloud (Edge Privacy Video Isolation)
Core Engineering Specifications
Scholarly Research & Technical Whitepapers