A touch-free smart home prototype. A Wi-Fi camera watches your hand: finger counts switch LEDs and a buzzer, and pinch or wrist angle sets motor speed, all live on a web dashboard.
[ Role ]
Hardware & full-stack engineer
[ Categories ]
- AI & Automation
- IoT & Hardware
[ Stack ]
- Python
- Flask + Socket.IO
- MediaPipe Hands
- OpenCV
- Vue 3 + Tailwind CSS
- ESP32-CAM (Arduino C++)
- ESP8266 (Arduino C++)
- mDNS + HTTP over Wi-Fi
I built a way to control real devices with nothing but hand motion, covering the full loop from camera to switch. An ESP32-CAM streams video over Wi-Fi to a Python server, where MediaPipe tracks the hand and OpenCV turns it into finger counts and rotation angles. The server drives an ESP8266 that switches LEDs and a buzzer and sets motor speed with PWM, all in real time. To keep it fast, I held one warm HTTP connection open and grouped commands into a single batch request. A Vue dashboard shows the live feed and device states.
- 01Two ways to control. Finger counts switch devices on and off, while pinch and wrist angles from MediaPipe Hands set motor speed live through PWM.
- 02No accidental triggers. A gesture must hold steady for 5 frames and pass a debounce timer before anything switches, so a passing hand does nothing.
- 03Fast device response. A kept-alive urllib3 connection and a batch endpoint on the ESP8266 switch several devices in one Wi-Fi request, not four.
- 04Zero-config networking. Both boards announce themselves over mDNS, and the ESP32-CAM saves Wi-Fi details in EEPROM with an access point fallback.