Overview
An R&D project exploring spatial computing interfaces — originally aimed at building a "Minority Report"-style spatial terminal with custom Android OS on AR glasses. After hitting thermal throttling and driver incompatibility blockers with legacy hardware, the approach pivoted to a Unity-based launcher using the XREAL NRSDK for 6DoF window pinning.
Pivot Solution
The current concept is a Unity app running as a home screen launcher on XREAL AR glasses. It would use the NRSDK for six degrees of freedom tracking, allowing users to pin application windows in 3D space around their environment. A companion ESP32 Bluetooth clicker bracelet solves "Gorilla Arm Syndrome" by moving interaction from raised-arm gestures to wrist-level button presses.
Hardware Concept
- AR Glasses: XREAL with NRSDK integration
- Gesture Input: ESP32 Bluetooth clicker bracelet
- Rendering: Unity with spatial anchoring
- Tracking: 6DoF head and hand tracking
Status
Research is complete. The original approach was proven infeasible. The pivot direction is documented but no new development has started. This project is on hold indefinitely while monitoring the rapidly evolving AR hardware landscape.