4 ms·
https://hn-wrapped.kadoa.com/RandyOrion https://hn-wrapped.kadoa.com/RandyOrion Well, as a local VRAM libertarian, to manually prune the safety alignment part
by RandyOrion 10mo ago
https://hn-wrapped.kadoa.com/RandyOrion https://hn-wrapped.kadoa.com/RandyOrion
Well, as a local VRAM libertarian, to manually prune the safety alignment part of a 500B LLM for it to run on 1GB RAM or VRAM is definitely a lifetime goal for me.