Developed Software, Designed and made Prototypes for Hobby, Assignment or Competitive Events
1st Prize at WinterHacks 2024 for AI-Powered Snow Detector (2024, aged 20)
We developed the solution "EyeSee" inspired by the need to improve winter navigation for the visually impaired. We saw an opportunity to harness machine learning to create a more intuitive and effective aid, addressing the specific challenges posed by snow and ice.
The system comprises dual cameras: one captures visible light, while the other is tuned for near-infrared imaging. The visible light camera feeds images to the neural network for analysis, and the near-infrared camera can be used to further enhance object detection accuracy in the scene.
It utilizes machine learning for quick object detection and an on-device inference system that can be used to detect snow after which EyeSee triggers a buzzer alert. This notification enables users to take immediate precautions or seek alternative paths, guided by the direction where the alert is not sounded. This intuitive design allows users to navigate more safely and confidently in snowy environments.
EyeSee combines a Raspberry Pi with an open-source Single Shot MultiBox Detector (SSD) model from Torchvision for real-time inference. This setup processes images from the dual cameras mounted at the front. Connected to the glasses is a head/neck band, which holds the Raspberry Pi and two 18650 batteries.
Developed an Omni-directional, Motion-Controlled Car using Arduino (2023, aged 19)
Developed a motion-controlled omnidirectional RC Vehicle with mecanum wheels
▲ Final Project Report (63 pages)
▲ Click the video above for a demonstration of the completed prototype
Gyro Sensor and Related Code
Working Prototype