Gesture Link

Gesture Link operates as an offline wearable assistive technology system that integrates smart glasses and smart gloves to bridge communication barriers. At the core of the system are microcontrollers like the ESP32-S3 and ESP32 DevKit v1, which coordinate data acquisition and feedback delivery. The smart gloves utilize multiple flex sensors and push-to-on buttons to capture hand gestures and manual inputs from a user. These gesture inputs are processed by the microcontroller, which can translate the physical signs into audible speech using the DF Player Mini audio module paired with a MAX98357A audio amplifier and speakers. To assist with navigation and environmental awareness, the system incorporates a 6-axis MPU for motion tracking, alongside a MAXREFDES117 bio-sensor and dual DHT11 sensors for monitoring biological or ambient metrics. Visual readouts are handled by miniature display options, including 1.3-inch and 0.96-inch OLED screens as well as a 1.8-inch TFT display. Additionally, an array of twelve vibration motors provides haptic feedback to the user, conveying directional cues or alerts without relying on external cloud connectivity. The entire setup is programmed using the Arduino IDE or ESP-IDF, making it a self-contained, wearable ecosystem for independent interaction.