Real-time Object Recognition on the Microsoft Hololens

We investigate the possibility of running object recognition tasks on the Microsoft HoloLens Augmented Reality (AR) headset in real time. Two different approaches are implemented: one using the Microsoft Project Oxford API, the other using a pre-trained neural network (YOLO) running on a local server. We find that while there are workarounds for the latency, the main obstacle to real-time performance is the HoloLens itself.