4 ms·

I recently got into creating avatars for VR and have used AI to learn Unity/Blender so ridiculously fast, like just a couple weeks I've been at it now. All the

I recently got into creating avatars for VR and have used AI to learn Unity/Blender so ridiculously fast, like just a couple weeks I've been at it now. All the major models can answer basically any question. I can paste in screenshots of what I'm working on and questions and it will tell me step by step what to do. I'll ask it what particular settings mean, there are so many settings in 3d programs; it'll explain them all and suggest defaults. You can literally give Gemini UV maps and it'll generate textures for you, or this for 3d models. It feels like the jump before/after stack overflow. The game Myst is all about this magical writing script that allowed people to write entire worlds in books. That's where it feels like this is all going. Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it.

anonzzzies 2y ago
You tried sharing your screen with Gemini intead of screenshots? I found it sometimes is really brilliant and sometimes terrible. It's mostly a win really.
- fixprix 2y ago
  I just tried it for the first time and it was a pretty cool experience. Will definitely be using this more. Thanks for the tip!
baq 2y ago
Look up blender and unity MCP videos. It’s working today.
- fixprix 2y ago
  Watching a video on it now, thanks!
ForTheKidz 2y ago
> The game Myst is all about this magical writing script that allowed people to write entire worlds in books. That's where it feels like this is all going. Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it. This is probably the first pitch for using AI as leverage that's actually connected with me. I don't want to write my own movie (sounds fucking miserable), but I do want to watch yours!
- iaw 2y ago
  I have this system 80% done for novels on my machine at home. It is terrifyingly good at writing. I expected Freshmen college level but it's actually close to professional in terms of prose. The plan is maybe transition into children's books then children shows made with AI catered to a particular child at a particular phase of development (Bluey talks to your kid about making sure to pick up their toys)
  - thisisnotauser 2y ago
    I think there's a big question in there about AI that breaks a lot of my preexisting worldviews about how economics works: if anyone can do this at home, who are you going to sell it to? Maybe today only a few people can do this, but five years from now? Ten? What sucker would pay for any TV shows or books or video games or anything if there's a comfy UI workflow or whatever I can download for free to make my own?
    - CamperBob2 2y ago
      What sucker would pay for any TV shows or books or video games or anything if there's a comfy UI workflow or whatever I can download for free to make my own? I think it's about time the industry faced that risk. They have it coming in spades. For example, LOST wouldn't have been such a galactic waste of time if I could have asked an AI to rewrite the last half of the series. Current-generation AI is almost sufficient to do a better job than the actual writers, as far as the screenplay itself is concerned, and eventually the technology will be able to render what it writes. Call it... severance.
    - numpad0 2y ago
      Only few are both capable and willing to take on creative tasks, with AIs or not. Boring people cannot form strong enough cohesive thoughts that can drive an AI, even if AI output itself were not as boring as they are.
    - fixprix 2y ago
      It breaks economics in a good way. Less resources spent on all kinds of media and other things is deflationary. Prices go down, a single person can provide for a family working less hours.
mclau156 2y ago
I have never seen knowledge to be the limiting factor in success in the 3D world, its usually lots of dedicated time to model, rig, and animate
- iamjackg 2y ago
  It's often the limiting factor to getting started, though. Idiosyncratic interfaces and control methods make it really tedious to start learning from scratch.
  - spookie 2y ago
    I don't think they are idiosyncratic. They are built for purpose, one simply lacks what to look for. Same for programming really. I also think that using AI would only lengthen the learning period. It will get some kind of results faster, though.
- spookie 2y ago
  If you need time dedicated to it, knowledge is the limiting factor.
tempaccount420 2y ago
> Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it. This is what Windows Copilot should have been!
- fixprix 2y ago
  I'm sure they're working on it. This MCP stuff is early days. Even I am just finding out about it's integration into Blender and Unity in this thread.
  - tough 2y ago
    There's already MCP's for both blender and unity and figma already
sinzin91 2y ago
You should check out Blender MCP, which allows you to connect Claude Desktop/Cursor/etc to Blender as a tool. Still early days from my experiments but shows where it could go https://github.com/ahujasid/blender-mcp https://github.com/ahujasid/blender-mcp
- dr_kiszonka 2y ago
  This looks great! Do you think you might add an option to use the model linked here instead of Hyper3D?

anonzzzies 2y ago

You tried sharing your screen with Gemini intead of screenshots? I found it sometimes is really brilliant and sometimes terrible. It's mostly a win really.

fixprix 2y ago
I just tried it for the first time and it was a pretty cool experience. Will definitely be using this more. Thanks for the tip!

baq 2y ago

Look up blender and unity MCP videos. It’s working today.

fixprix 2y ago
Watching a video on it now, thanks!

ForTheKidz 2y ago

> The game Myst is all about this magical writing script that allowed people to write entire worlds in books. That's where it feels like this is all going. Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it. This is probably the first pitch for using AI as leverage that's actually connected with me. I don't want to write my own movie (sounds fucking miserable), but I do want to watch yours!

iaw 2y ago
I have this system 80% done for novels on my machine at home. It is terrifyingly good at writing. I expected Freshmen college level but it's actually close to professional in terms of prose. The plan is maybe transition into children's books then children shows made with AI catered to a particular child at a particular phase of development (Bluey talks to your kid about making sure to pick up their toys)
- thisisnotauser 2y ago
  I think there's a big question in there about AI that breaks a lot of my preexisting worldviews about how economics works: if anyone can do this at home, who are you going to sell it to? Maybe today only a few people can do this, but five years from now? Ten? What sucker would pay for any TV shows or books or video games or anything if there's a comfy UI workflow or whatever I can download for free to make my own?
  - CamperBob2 2y ago
    What sucker would pay for any TV shows or books or video games or anything if there's a comfy UI workflow or whatever I can download for free to make my own? I think it's about time the industry faced that risk. They have it coming in spades. For example, LOST wouldn't have been such a galactic waste of time if I could have asked an AI to rewrite the last half of the series. Current-generation AI is almost sufficient to do a better job than the actual writers, as far as the screenplay itself is concerned, and eventually the technology will be able to render what it writes. Call it... severance.
  - numpad0 2y ago
    Only few are both capable and willing to take on creative tasks, with AIs or not. Boring people cannot form strong enough cohesive thoughts that can drive an AI, even if AI output itself were not as boring as they are.
  - fixprix 2y ago
    It breaks economics in a good way. Less resources spent on all kinds of media and other things is deflationary. Prices go down, a single person can provide for a family working less hours.

mclau156 2y ago

I have never seen knowledge to be the limiting factor in success in the 3D world, its usually lots of dedicated time to model, rig, and animate

iamjackg 2y ago
It's often the limiting factor to getting started, though. Idiosyncratic interfaces and control methods make it really tedious to start learning from scratch.
- spookie 2y ago
  I don't think they are idiosyncratic. They are built for purpose, one simply lacks what to look for. Same for programming really. I also think that using AI would only lengthen the learning period. It will get some kind of results faster, though.
spookie 2y ago
If you need time dedicated to it, knowledge is the limiting factor.

tempaccount420 2y ago

> Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it. This is what Windows Copilot should have been!

fixprix 2y ago
I'm sure they're working on it. This MCP stuff is early days. Even I am just finding out about it's integration into Blender and Unity in this thread.
- tough 2y ago
  There's already MCP's for both blender and unity and figma already

sinzin91 2y ago

You should check out Blender MCP, which allows you to connect Claude Desktop/Cursor/etc to Blender as a tool. Still early days from my experiments but shows where it could go https://github.com/ahujasid/blender-mcp https://github.com/ahujasid/blender-mcp

dr_kiszonka 2y ago
This looks great! Do you think you might add an option to use the model linked here instead of Hyper3D?