2 ms·
Could not get any usable output from it for any real usecase. Can't see any real value in using 1 bit llms except and apart for the sake of running it for demo
by indianmouse 3mo ago
Could not get any usable output from it for any real usecase.
Can't see any real value in using 1 bit llms except and apart for the sake of running it for demo or feel good factor of running a higher param model locally and in limited hardware!
Since use as it is very limited, could someone throw some light on any actual use case?
- richrichardsson 3mo ago[dead]
- deleted 3mo ago[deleted]