muyuu

22 ms·

391.
by muyuu 4y ago
I found it ready-made for download, here https://huggingface.co/eachadea/ggml-vicuna-13b-4bit
392.
by muyuu 4y ago
There certainly was cold and hardship, definitely in parts of Central Europe and the UK. You may not have suffered, but many people have.
393.
by muyuu 4y ago
if by efficient you mean living in cold and hardship, blanketing up at home to sleep away the cold nights, then yes
394.
by muyuu 4y ago
the wealthier cities won't remain wealthier forever with rampant crime and civil disarray once upon a time, not that long ago from a historical PoV (the 1950s), Detroit was THE wealthiest city in the USA and it's now among the poo
395.
by muyuu 4y ago
btw I got 4bit quantized Vicuna working in my 16GB laptop and the results seem very good, perhaps the best I got running locally so far
396.
by muyuu 4y ago
perhaps my mention that other solutions are proprietary was not welcome by the purveyors of such solutions
397.
by muyuu 4y ago
your task is very very broad you mention you don't want to deal with AWS, if it's because of ad-hoc installation concerns and nothing else you can just run your notebooks in ready-made solutions like Google Colab, or Jupyter-book
398.
by muyuu 4y ago
consumer hardware is a bit vague of a limitation, which I guess it's partly why people are not tracking precisely what runs on what very closely these could be useful: https://nixified.ai https://github.com/
399.
by muyuu 4y ago
i honestly do not know what is worse from the three realistic alternatives: 1- to have large corporations and people with privileged access to them have these models exclusively and have them collaborate as a clique 2- to have those models
400.
by muyuu 4y ago
like that but requiring 60GBs of CPU RAM for some reason :-P one has to wonder how did they implement the storage of those deltas to require that sort of RAM
401.
by muyuu 4y ago
would still be possibly legal on the basis that if it's not illegal then it's legal - in British jurisprudence tradition at least https://en.wikipedia.org/wiki/Everything_which_is_not_forbid... - namely it&#x
402.
by muyuu 4y ago
I believe he just wants to do his bit by removing his activity from github towards lowering their dominance numbers in the space. I don't think he intends to stop those LLM code models.
403.
by muyuu 4y ago
perhaps they do it more I live near the DLR and I see vandalised, abandoned Boris bikes on the regular
404.
by muyuu 4y ago
both in MacOS and in Windows you are mere cattle there is no reason to keep using a walled, closed desktop OS in the 2020s
405.
by muyuu 4y ago
it's more control than letting people own them, in a certain aspect of course, carelessness is a problem but that also happens with so-called Boris bikes (Livingstone bikes)
406.
by muyuu 4y ago
maximising revenue and control from the authority it makes sense in a way
407.
by muyuu 4y ago
Xine, mplayer, divx, xvid, etc these things were a lot more temporary than I anticipated, but it does make sense when you take into account the competitive advantage of newer codecs, hardware acceleration, etc. And of course the death of th
408.
by muyuu 4y ago
ggml-model-f16.bin and ggml-model-q4_0.bin those are the output of convert-pth-to-ggml.py and quantize respectively I had to cancel 30B as I needed to use the computer after some 12 hours, now I have to fix the ext4 filesystem of the drive
409.
by muyuu 4y ago
It actually happened. With paging and bigger word sizes, which were common in 32 bit systems even with hardware acceleration. A 32bit address space only means you have 4GibiAddresses, which do not need to be pointing to single bytes. In fac
410.
by muyuu 4y ago
Can you share the intermediate files? They're taking ages to process on my 16GB-RAM laptop
411.
by muyuu 4y ago
the ggml-model-f16.bin file for 30B is taking me a bunch of hours to process are these made available somewhere?
412.
by muyuu 4y ago
the README.md file of the repository is not updated to reflect these changes yet, right?
413.
by muyuu 4y ago
chicken scheme comes to mind anyone around knows how does it compare to Chicken?
414.
by muyuu 4y ago
> Teams invest many person-years into building software on top of cloud services assuming certain prices & cost structures. part of the implicit risk in using someone else's computers on the bright side, when a large provider ch
415.
by muyuu 4y ago
twitter lost copious amounts of money even with unprecedented revenue (from institutional ads one would assume, as it had never happened to that degree before or since, and private ads were cheap in 2021) https://i.imgur.com&#x2F
416.
by muyuu 4y ago
a year ago it had just lost over US$1B over the running year
417.
by muyuu 4y ago
I don't think Twitter is alone in that respect. Twitter is unique in that it was acquired for US$ 44B when it was a business that lost huge amounts of money consistently for years, and the owner intended it to have it run old school st
418.
by muyuu 4y ago
there is a clear self-reinforcing loop between A what's offered and B what's picked that is based on both A and B looking for the trend and only slightly controlled by A and B looking not to be too generic and to be somewhat origi
419.
by muyuu 4y ago
yea I do wonder about this, but even Meta are acting as if their releasing it means in effect that the cat is out of the bag at this point, their not even complaining about it must mean that they accept the data is public now
420.
by muyuu 4y ago
I wonder if these developments won't eventually result on a split, when at some point Ubuntu would rather not keep up with Debian packages, or talk things through upstream. Perhaps when there are some fundamental differences of directi

More ›