I think you can do a lot of this with React-three-fiber:https://docs.pmnd.rs/react-three-fiber/getting-started/introduction https://docs.pmnd.rs/react-three-fib

I think you can do a lot of this with React-three-fiber:https://docs.pmnd.rs/react-three-fiber/getting-started/introduction https://docs.pmnd.rs/react-three-fiber/getting-started/intro... in combination with React-three-flex: https://github.com/pmndrs/react-three-flex https://github.com/pmndrs/react-three-flex . React-three-fiber lets you make three.js components in react, and react-three-flex will let you do flexbox style layouts to make interesting UIs. You still get all of the capabilities of three.js with a lot of the plumbing done for you. Check out the examples from react-three-flex for some examples close to what it sounds like you want to achieve.