3 ms·
Three-LLM: Three.js-based WebGPU LLM inference engine
- esperent 1mo agoWhat makes a 3d graphics rendering engine a good fit for llm inference?
- bhouston 1mo agoThreeJs has an abstraction that allows you to write your shaders using JavaScript, it is called ThreeJS Shading Language. This implementation makes of that to simplify development: https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Language https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Lan...
- anematode 1mo agoThat makes very little sense when you can just use WebGPU and have fine-grained control... for something like LLM inference, having this kind of abstraction seems like quite a hindrance
- bhouston 1mo agoOkay. I will give a raw WebGPU implementation a try and see if it is smaller and more efficient.
- jauntywundrkind 1mo agocan someone please go ham on a newer three.js, preferably with a lot of A-frame built in, for the modern era, that is also webgpu native? pretty please?