4 ms·
Eh. It is good in terms of results ( accuracy, good recommendations and so on ), but slow when it comes to actual inference. On local 128gb machine, it took ove
by iugtmkbdfil834 6mo ago
Eh. It is good in terms of results ( accuracy, good recommendations and so on ), but slow when it comes to actual inference. On local 128gb machine, it took over 5 minutes to brainstorm garage door opening mechanism with some additional restrictions for spice.
- 2ndorderthought 6mo agoI find it hilarious how waiting 5 whole minutes to design software is considered slow in a way that people refer to as not useful. My god lol. Is that 128gb RAM or VRAM?
- iugtmkbdfil834 6mo agoIts the unified memory in this case ( Ryzen AI max ) so obviously there is some room for improvement there. Still, I would not dismiss the speed out of hand. Remember, we are trying to argue here that 'it is pretty close already'. In ways, it is. It others, it is not yet.