Thanh Pham

ML Developer · 2018 · AI & ML · shipped

Auto-Navigated 360 Video

YOLO-powered auto-navigation for 360 video.

Open it on the map

Lesson

Combining emerging tech (AI + VR) creates unique demos.

The lesson in full: The Deep Learning specialization on Coursera led to this practical application: camera auto-follows people in 360 video like Facebook Portal.

What it is

Driven by curiosity about AI and its potential, I completed Coursera’s Deep Learning specialization and combined that knowledge with 360 VR. The result: an auto-navigation system for 360 video using YOLO object detection on TensorFlow.js. Similar to how Facebook Portal’s camera automatically zooms and follows people, this demo does the same in 360 video.

Auto-Navigated 360 Video, picture 1 of 1

Tools and technologies

TensorFlow.js · YOLO · Deep Learning

Links

Lineage

Built on lessons from VR Video Player, 360 Video Production.

Lessons carried into Spatial Inspection Video.