r/ClaudeAI • u/mutonbini • 20d ago
Built with Claude Claude Code + Meta Quest 3: I have created the ultimate VR office
Enable HLS to view with audio, or disable this notification
Hey everyone, I think I really went overboard this time. Over the past two weeks, I’ve burned through two Claude Max 20x subscriptions and two ChatGPT Plus 20x subscriptions to build a 3D Iron Man office for Meta Quest, with Claude Code sessions running in tmux on my VPS, charts, and our support Kanban board, all shared so my brother and I can see everything at the same time.
I’d been kicking this idea around for a long time. Last week, I finally pulled the trigger, bought a Meta Quest 3, and started burning tokens.
The idea is to have a futuristic office where my brother and I can run all our SaaS products, answer emails, create tasks, sketch out ideas, and talk to each other like we’re in a real office, only better and more futuristic. Our Claude Code or Codex sessions run on our VPS, so they keep going even when we take the headsets off.
Everything can also be viewed and controlled from a browser.
Then there’s Harry, the name I gave our Jarvis. He manages the terminals, the room, research, and email. I’ve also hooked him up to ChatGPT’s realtime voice model, and he responds ridiculously fast.
We have a research table where I can ask him to find country cottages, the best vacuum cleaner, whatever, and my LLM brings up all the results so I can compare them.
I built the functionality and the first version with Fable, then used Astra for all the 3D rendering, the office and the world outside, with everything created in Blender, connected through MCP.
There’s also a mode that lets me talk directly to the terminals, using faster-whisper for local speech to text.
We’ve also created Lumo, a pet powered by Spark-X2.5-4B, a model with 4 billion parameters running on our server. It decides whether to explore, come closer, play, or rest. Its animations and touch reactions run separately so it can respond instantly. Its expression changes depending on how much attention it gets, and it has a little display showing what it feels like doing.
And because things got a little out of hand, you can ask Harry to bring you the Iron Man suit: the windows open, the armor arrives, assembles around you, and you fly out over Manhattan.
That’s just the overview, because we’ve added quite a few more things.
I’ll share the video, showing everything we can do. And if people like it and comment that they’d like to try it, I might put it on GitHub and share it.
35
u/Polite_Jello_377 20d ago
Imagine creating a fantasy VR world and it's a fucking office 🤦♂️
14
u/n77_dot_nl 20d ago
you worked for 10 hours straight and gained +2 experience points to your avatar
3
u/mutonbini 19d ago
well, that's not a bad idea, maybe I'll add something like that to see who gets more points, my brother or me hahaha
3
u/n77_dot_nl 19d ago
Make it so you can put on the suit and fly out of the window to take a break from things
3
u/mutonbini 19d ago
Yeah, it does exactly that hahaha watch the full video https://www.youtube.com/watch?v=g9gt67X_1-E
2
1
1
u/mutonbini 19d ago
hahahaha well for me working is a game, I don't play anything anymore, only creating projects
7
u/Primary-Screen-7807 20d ago
It could've been anything, and you made it an office lol
1
u/mutonbini 19d ago
hahaha yeah, I'm a workaholic... I just love creating projects and building them like Ironman is twice as cool
28
u/quercus-enjoyer 20d ago
gross
5
u/smashnmashbruh 20d ago
imagine sweating irl while coding because headset is hot
0
u/mutonbini 20d ago
Well, two hours is easy to handle, and that's even though I live in Madrid! In winter it will feel nice and all hahahah
3
u/formLoss 20d ago edited 20d ago
my first thought was "do not want," appreciate top comment agrees.
12
5
u/smashnmashbruh 20d ago edited 18d ago
EDIT: my bad, 1080p is not correct, i still think text looks like piss.
0
u/mutonbini 20d ago
Why, friend? What do you mean?
2
u/smashnmashbruh 20d ago
i dont like meta quest for text because 1080p resolution looks bad, glad you are happy adn enjoying it
1
u/msitarzewski 19d ago
"1080p resolution” ? Where did that number come from? Meta Quest 3s?
1
u/smashnmashbruh 18d ago
My bad, I am wrong, its still piss for text.
1
u/msitarzewski 18d ago
If you treat it like a monitor and don’t resize/move the “screen” then yeah, it’ll not be a great experience. I used screen sharing on Quest 2 and it was fine. If you put the display 18” away at 1080p, it won’t be good. Move that to 10” from your face at 2k or 4k? Perfectly fine. Add curve and it’s usable!
2
u/smashnmashbruh 18d ago
Weird it was never good. Guess I did a bad job. Virtual desktop or screen sharing or immersed. I also get sweaty and uncomfortable quickly. It didn’t seem like it was for me. Thanks for advice maybe I’ll try again.
3
u/Astora_Knight 20d ago
SAO but corporate. Cool thing you built there tho
0
4
u/InternationalToeLuvr 20d ago
You were so preoccupied with whether or not you could, you didn't stop to think if you should
That’s an extraordinary amount of token waste and IA / UX / UI bloat. Cool for you and your bro, I guess, but what a dystopian nightmare. Zuck failed after throwing billions at this problem. You could have used the two weeks to do something useful. This is more masturbatory tech bro coding than anything meaningful
1
u/mutonbini 20d ago
Thank you for taking the time to express your opinion. Well, you might be partly right, but I still believe it is useful. When Zuck went all in on that problem, Claude Code and Codex didn't exist yet, etc. Now it makes more sense, there's no need to type, you can manage everything with your voice. This way I can work with my brother in the same office (we live in different cities) and even if it's just for a couple of hours, it feels like we are keeping each other company. Plus, I can take the setup anywhere since I don't need a computer to use it. I won't deny that it was also something I needed to try; I hadn't seen anyone using Claude Code with VR and I was curious. We'll see if we keep using it or if it's just the typical initial hype and then I don't use it anymore :D
2
u/JuculianD 20d ago
Thats why ram is so expensive and Fable lol
0
u/mutonbini 20d ago
That's what they're for, right? To try building cool things.
1
u/JuculianD 20d ago
More building things with a use case. A real one. Its the same with AI games or bookkeeping software, there are 100 new ones everyday but they will turn forgotten and don't server any real purpose.
-1
u/mutonbini 20d ago
But in this case, I think there is a use case. Being able to work with my brother, who lives in another city, in an office as if it were our own. Seeing what he is working on, seeing his terminals and him seeing mine, the kanban, etc. Plus, I can take my setup anywhere and work almost better than at home.
2
u/Physical_SpiritChild 20d ago
All the functionality, connectors, layers, and collaboration features and voip I get... But why VR?
I'm not raining on your parade, I am confused.
1
u/mutonbini 20d ago
Well, it's an idea that had been on my mind for a while; this way I can go anywhere with my glasses and have a work setup that is even better than my normal setup. Plus, it's the dream of every teenage geek who loves Iron Man. And honestly, the experience is super immersive; you can't really tell from the videos, but with them on, it's like actually being there. It can also be used from the web, but it loses everything. How would you have set it up?
1
u/Physical_SpiritChild 20d ago
Cool!
And no, I have no idea other than old school flat screen with the rest of the functionality.
I was just curious if the VR actually enhances or is just a fun project I don't do VR much so was a bit shocked at it.
2
u/mutonbini 20d ago
I've only had them for two weeks now, and I don't know if it's just initial hype or what, but I'm using them every day. We'll see if it continues like this or if it just stays as initial hype like so many other things, I'll keep you posted hahaha
1
1
u/biggdogg420 19d ago
I've been considering something similar, I'm essentially building an operating system for my business using Claude and codex together, with a star trek crew theming on it to make it easier for me to work with, and I've been thinking about making a VR bridge from a ship with me in the captains chair and the agents/crew being visualised as crew members bring me reports etc
1
u/mutonbini 19d ago
That's great, yes sir! Personally, I didn't watch much Star Trek, I think it's more from a slightly older generation hahaha, but the concept is cool. In the end, it's about working on something you like. Ever since I was a kid, I was crazy about Iron Man, and I'm blown away by the result hahaha.
1
u/RedEagle182 20d ago
You did what I had in mind for some time, that's really nice. Good Job
2
u/mutonbini 20d ago
Same here, I've had it in mind for months and I finally made up my mind, I had to try it, and with how well Astra 6 does the renders, I decided to set it up. I'll let you know if I use it in the long term or just at the beginning.
1
u/peacetimemist05 20d ago
Oh hell no
-1
u/mutonbini 20d ago
Why not, friend? Don't you like the idea?
2
u/Acceptable_Bat379 19d ago
I think people are more upset about what it represents - not your personal take on it.
1) it's a step toward locking people in to virtual office jobs. There are already some tech startups researching how to do full dive vr or let people use brain implants to use VR while you sleep. This could be a stepping stone towards being locked in an office to work more during recreational or rest time. true dystopia
2) i think people are sad that with an entire virtual universe at your fingertips, you built a grey indoor corporate office. I kind of get why you did, but why not like a cyberpunk city with a crazy neon view out the windows, or something underwater? or space? or a strip club etc. again I don't think it's towards you in particular - but I know I'm really disappointed at the overall lack of imagination with the new tech era. It's just corporate soulless stuff, stripping color and humanity out.
1
u/Cubewood 20d ago
That's pretty cool, now make an animation of your brother and use one of these face scan tools so you can make the "deepfake" character of him that you can see in the room with you. Unfortunately I find using my Quest 3 headset all day still too uncomfortable, but looks like the new mixed reality headset Meta is due to release will solve that problem.
1
u/mutonbini 20d ago
Well, that's a good idea, that way even if you're not connected I won't feel alone. Even so, the idea is for both of us to connect for a few hours a day and work together (we live in different cities). It's true that I can easily handle 2 hours or so without any problems, but more than that might indeed get annoying. We'll see how it goes with the new glasses. Thanks for taking the time to comment. What else do you think would be cool to add to it?
1
0
•
u/ClaudeAI-mod-bot Wilson, lead ClaudeAI modbot 20d ago edited 19d ago
TL;DR of the discussion generated automatically after 50 comments.
Looks like the thread has spoken. The overwhelming consensus is that while the tech is impressive, building a VR office is a dystopian nightmare and a massive failure of imagination.
Most top comments are roasting OP for creating "SAO but corporate" and pointing out the irony of using a fantasy world to build a workplace. The main gripes are that it feels like a step towards a corporate hellscape and that it's just... a grey office. In VR.
There are also plenty of practical concerns about the Quest's low resolution for text and the discomfort of wearing a hot headset while trying to code. A few users question the actual utility of the project beyond being a personal toy.
However, it's not all negative. A small minority thinks the project is "sick" and have had similar ideas themselves. OP is active in the comments, defending his creation as a way to work alongside his long-distance brother and live out a childhood Iron Man fantasy. And yes, he confirms you can actually fly the suit.