Samueli School of Engineering

Envision is an embedded device used to wirelessly control a computer over Bluetooth using hand gestures. The device uses an onboard Tensor Processing Unit (TPU) to provide gesture data to the user’s PC with low latency and low power.

This device was developed to democratize gesture app development, slashing the hardware and knowledge requirements to develop hand gesture applications. We created an SDK by exposing features like fingertip positions or pinch strength through event-driven non-blocking APIs. Our improved SDK reduced demo app size by about 80% for prototype gesture interaction apps.