Anduril built a military headset that lets soldiers see through walls, overlay drone feeds, and track targets with AI. It costs a defense contract and $30k+ per unit. I wanted to see how close I could get with a $300 pair of Meta Ray-Bans and off-the-shelf visual positioning technology.
Turns out, you can get surprisingly close. A camera is all you need — no depth sensors, no LiDAR, no SLAM. Just a pre-scanned 3D map and a pair of consumer glasses. This video covers how VPS works, why GPS can't solve this problem, what it looks like when you can track someone through walls using a smartphone, and why this same technology will be in every robot, drone, and self-driving car on the planet.
Prior VPS Video: https://youtu.be/zBHtZ1XGThA
CHAPTERS:
0:00 - The Experiment
0:38 - Dumb Glasses, Smart Tracking
1:54 - No Street View? No Problem
3:17 - Seeing Through Walls With a Phone
4:24 - The Indoor Problem Nobody Solved
5:20 - This Is What It Can Do
6:38 - Use Cases Beyond the Flex
7:44 - The Double Edge
10:32 - Conclusion
References:
Anduril EagleEye — https://www.anduril.com/eagleeye
MultiSet AI (VPS platform) — https://www.multiset.ai/
MultiSet developer SDKs — https://www.multiset.ai/developers
Google ARCore Geospatial API — https://developers.google.com/ar/develop/geospatial
Niantic Spatial Platform — https://www.nianticspatial.com/products/visual-positioning-system
--
Subscribe for more in-depth AI & creative tech videos! 👉 @bilawalsidhu
Join My Newsletter: https://spatialintelligence.ai
Connect with me on X/Twitter here: https://x.com/bilawalsidhu
Everywhere else here: https://bilawal.ai
Business inquiries: [email protected]
Bio:
Bilawal Sidhu is a creator, engineer, and product builder obsessed with blending reality and imagination using art and science. Bilawal is the technology curator for TED Talks, and a venture scout for Andreessen Horowitz. With more than a decade of experience in the tech industry, he spent six years as a product manager at Google, where he worked on spatial computing and 3D maps. His work has been featured in major publications including Bloomberg, Forbes, BBC, CNBC, and Fortune, among others. Bilawal’s journey into computer graphics began at 11, when he fell in love with seamlessly blending 3D into real life footage. Since then, he's captivated over 1.5M subscribers, garnering more than 500M+ views across his platforms. Driven by a mission to empower the next generation of artists and entrepreneurs, Bilawal openly shares AI-assisted workflows and industry insights on social media. When he’s not working, you can find Bilawal expanding his collection of electric guitars.
TED: https://www.ted.com/speakers/bilawal_sidhu
Runtime 00:11:23
meta ray-ban, smart glasses, VPS, visual positioning system, see through walls, augmented reality, AR, eagle eye, anduril, spatial intelligence, 3D tracking, gaussian splatting, indoor navigation, multiset, meta glasses, wall hack, consumer AR, spatial computing, AI tracking, mixed reality,
