4 ms·

An LLM frontend for this would be amazing. You could describe the scene you want in normal english and iterate eith conversation. It could automatically creat

An LLM frontend for this would be amazing. You could describe the scene you want in normal english and iterate eith conversation. It could automatically create scenes from novels and poems.

lylabs 2y ago
true, but that's very easy to do as long as the LLM can create the code, which shouldn't be difficult... idk blender's code lang used (i know godot is very python-like), but most code is nowadays some form of cpp (or it is cpp), so with a few-shot it might be even possible to get a cpp trained llm gen the correct code
aDyslecticCrow 2y ago
The whole point of this is to generate diverse training data with accurate labels for model training. If you actually want to create nice scenes, use normal blender and some plugins and free online assets.
- vdjskshi 2y ago
  I was thinking of it as an end-product for use by the average joe rather than a tool for professionals like blender. Imagine wearing an apple vision and building your memory palace through a verbal conversation with an AI.
  - aDyslecticCrow 2y ago
    Blender is pretty approachable. How far are we lowering ourselves to be considered average joe? If it's "a few hours of poking" then sure. But you can create some decent procedural nature stuff with a few free plugins and a weekend or two of learning the basics of the program. Can we not let creative things take a bit of minimal effort? When we already have tools that make it nearly trivial as is. https://www.thegrove3d.com/ https://www.thegrove3d.com/ https://blendermarket.com/products/quick-landscape https://blendermarket.com/products/quick-landscape https://blendermarket.com/products/bagaivy https://blendermarket.com/products/bagaivy https://forums.unrealengine.com/t/plugin-landscape-combinator-a-plugin-to-create-real-world-landscapes-free-for-personal-use/772305 https://forums.unrealengine.com/t/plugin-landscape-combinato...

An LLM frontend for this would be amazing. You could describe the scene you want in normal english and iterate eith conversation. It could automatically create scenes from novels and poems.

lylabs 2y ago

true, but that's very easy to do as long as the LLM can create the code, which shouldn't be difficult... idk blender's code lang used (i know godot is very python-like), but most code is nowadays some form of cpp (or it is cpp), so with a few-shot it might be even possible to get a cpp trained llm gen the correct code

aDyslecticCrow 2y ago

The whole point of this is to generate diverse training data with accurate labels for model training. If you actually want to create nice scenes, use normal blender and some plugins and free online assets.

vdjskshi 2y ago
I was thinking of it as an end-product for use by the average joe rather than a tool for professionals like blender. Imagine wearing an apple vision and building your memory palace through a verbal conversation with an AI.
- aDyslecticCrow 2y ago
  Blender is pretty approachable. How far are we lowering ourselves to be considered average joe? If it's "a few hours of poking" then sure. But you can create some decent procedural nature stuff with a few free plugins and a weekend or two of learning the basics of the program. Can we not let creative things take a bit of minimal effort? When we already have tools that make it nearly trivial as is. https://www.thegrove3d.com/ https://www.thegrove3d.com/ https://blendermarket.com/products/quick-landscape https://blendermarket.com/products/quick-landscape https://blendermarket.com/products/bagaivy https://blendermarket.com/products/bagaivy https://forums.unrealengine.com/t/plugin-landscape-combinator-a-plugin-to-create-real-world-landscapes-free-for-personal-use/772305 https://forums.unrealengine.com/t/plugin-landscape-combinato...