TobiasEnholmX

3 ms·

1.
by TobiasEnholmX 2y ago
Yeah, exactly. Gaussian Splatting works great when you have an image (or set of images) and want to reconstruct a whole scene in 3D, but it treats everything as a unified point-based representation. In a structured 3D scene, though, objects
2.
by TobiasEnholmX 2y ago
Appreciate the feedback! Sounds like you're looking for more of a deep dive into the tech and how it works. This post was more about showing results, but we’ll cover the process and technical details in another one
3.
by TobiasEnholmX 2y ago
Glad you like it! In the blog post you can find my email, or join the discord https://discord.gg/backdrop
4.
by TobiasEnholmX 2y ago
We’re actually finding that leveraging 3D reduces complexity rather than increasing it. Setting up a 3D scene is getting easier with tools like image-to-3D, and once it's set up, you can reuse it flexibly across different shots without
5.
by TobiasEnholmX 2y ago
Fair point! We debated whether to post this here since it's more about examples rather than the full how-to and technical breakdown. Next post, we’ll aim to go deeper into the process and techniques behind it. Appreciate the feedback!
6.
by TobiasEnholmX 2y ago
First off, I’d love to hear more about your experience. If you’re up for a chat, shoot me an email at tobias@backdrop.tech, or let me know where I can learn more about what you’ve worked on! 1. I assume you mean patience when setting up a 3
7.
by TobiasEnholmX 2y ago
Yeah, I see what you mean! When we say 3D here, we mean working with actual 3D scenes—models, depth, and lighting—rather than the '3D movie' style like Pixar. The goal is to use 3D to control AI generations more precisely, so thin
8.
by TobiasEnholmX 2y ago
I just checked and it works for me, but I'm on IOS. There is a fallback that sends each subscriber to my email as well
9.
by TobiasEnholmX 2y ago
That makes sense! Giving AI a structured starting point so it doesn’t go off the rails is similar to what we're doing with 3D. Instead of letting it hallucinate frame by frame, we define the space, characters, and style upfront—so the
10.
by TobiasEnholmX 2y ago
Yeah, modeling and animating used to be a huge bottleneck, but with tools like image-to-3D and improving AI animation models, it's getting easier and faster. The goal here isn’t to replace animation but to use 3D as a guide, so AI does
11.
by TobiasEnholmX 2y ago
Good question! When we say '3D' here, we mean using 3D models and scenes as a base to guide AI video generation. The AI isn’t just making things up from scratch—it follows the structure of a 3D-rendered scene to keep things consis
12.
by TobiasEnholmX 2y ago
Yeah, that’s pretty much the idea. AI has a lot of freedom when generating each frame independently, which often leads to inconsistencies. By using a 3D base, we’re constraining that freedom. Locking in composition, lighting, and perspectiv
13.
Experiment: Can 3D improve AI video consistency?(backdroptech.github.io)
65 points by TobiasEnholmX 2y ago|36 comments
14.
by TobiasEnholmX 2y ago
AI-generated video struggles with consistency. Flickering, weird proportions, and characters changing. I tried using 3D as a way to get more consistency. Overall, it worked. No sudden changes in proportions, clothing, or style. Still, there
15.
by TobiasEnholmX 4y ago
Ambient co-founder here. You're right, thanks for the feedback, we'll update the website with one soon.