KinoVision - Where Visual Sensing Meets Motion-Driven Control

KinoVision functions as a wearable, gesture-controlled smart home automation system by integrating optical sensing, motion tracking, and wireless microcontroller logic. At the heart of the setup are the Adafruit Memento Programmable Camera and the XIAO ESP32-S3 microcontroller, paired with an MPU6050 IMU sensor mounted on a wrist band. The camera acts as a vision pendant that captures visual inputs from the user's environment, while the MPU6050 tracks physical hand gestures and motion dynamics through its accelerometer and gyroscope. These sensor readings are processed locally by the ESP32 boards and communicated over the Adafruit IO MQTT Broker to coordinate system responses. When a specific pre-programmed gesture or visual trigger is recognized, the microcontroller switches a relay module on or off. Because the relay acts as an electrically isolated electronic switch, it safely interrupts or completes the circuit powering an external light bulb connected to AC mains. Portable power is supplied by dual 3.7V LiPo batteries connected to the development boards via breadboards and jumper wires, allowing the entire wearable tracking and sensing rig to operate untethered while seamlessly interfacing with physical home appliances.