sp332

57 ms·

811.
by sp332 3y ago
llama.cpp support is here already via https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF And yes it works fine in oobabooga.
812.
by sp332 3y ago
They clarified https://news.ycombinator.com/item?id=37677311 that it should only need 16GB, but the unoptimized runtime currently takes 24.
813.
by sp332 3y ago
Interesting, and that requirement is repeated on the cloud deployment pages, even the unfinished ones where that is the only requirement listed so far. https://docs.mistral.ai/category/cloud-deployment I wonder if th
814.
by sp332 3y ago
And how much poorer would the rest of the world be?
815.
by sp332 3y ago
According to https://wolvic.com/en/faq/ it uses GeckoView. Wolvic currently uses GeckoView. That said, as part of our experimentation in 2021, we showed a version of Firefox Reality backed with WPE WebKit through
816.
by sp332 3y ago
One parameter is 16 bits == 2 bytes. So a model with 7 billion parameters needs 14GB of RAM for the un-quantized model, plus some overhead for the KV cache and other "working memory" stuff but that should be fairly low for a 7B mo
817.
by sp332 3y ago
Aside from the sliding attention window, I don't see them mention any particular reasons for the incredible performance. I would like to see some tests for benchmark contamination in the training set.
818.
by sp332 3y ago
Yes, and it happens more for things that feel out of scope for the part of the program that I'm interested in. After all, we import library code from random strangers into our programs all the time for the parts we consider "plumb
819.
by sp332 3y ago
It doesn't equal infinity, it is undefined. x/n approaches infinity as n goes to 0, but at n=0 there is no answer. One way to think of it is x/n = m therefore n * m = x. You can recover the original value by multiplying the
820.
by sp332 3y ago
My bed has 4 or 5 light fixtures that can shine on it, and only one is easily reachable from the bed.
821.
by sp332 3y ago
To clarify, the the claim is that individuals are more sociable when they are infected with the flu virus. These results show that there is an immediate active behavioral response to infection before the expected onset of symptoms or sickn
822.
by sp332 3y ago
Right now, "can you melt down an egg" says no, and links to Ars Technica's article about the Quora problem as the source. https://arstechnica.com/information-technology/2023/09/can-y...
823.
by sp332 3y ago
They need a large runtime and are slow to start up.
824.
by sp332 3y ago
I don't use Quora much, but this widget has been at the top of every page I think.
825.
by sp332 3y ago
In the US, I got access almost immediately when I signed up in June.
826.
by sp332 3y ago
Oh yeah, I left a tarp over a project one summer and was shocked at how much of it flaked off into the yard. At least it was down-slope from the well pump.
827.
by sp332 3y ago
I thought 5G was mostly about managing congestion. What's the improvement over 4G for most users?
828.
by sp332 3y ago
You really have to put some wear on a piece of plastic to get microplastic particles. Washing polyester clothes and driving cars on "rubber" tires for example.
829.
by sp332 3y ago
How long?
830.
by sp332 3y ago
They're probably trying to tune a language model.
831.
by sp332 3y ago
And MIMO means the AP can talk to multiple such clients at the same time, even if each iPhone is only using 2x2.
832.
by sp332 3y ago
More kids got Covid than got the vaccine.
833.
by sp332 3y ago
Yup, that was the one.
834.
by sp332 3y ago
I would expect the mother’s immune system to reject the foreign cells though.
835.
by sp332 3y ago
The Verge isn't paywalled though?
836.
by sp332 3y ago
The large models generalize better. The small models are easier to train for specific tasks.
837.
by sp332 3y ago
Parts 1 and 2 do explain a lot of the decisions made, and I liked the process of improvising with lots of experience.
838.
by sp332 3y ago
When you put a generator on it, which is what the thread is about.
839.
by sp332 3y ago
Impressive gains, but 22% on GSM8K is maybe not an attention-grabbing end result.
840.
by sp332 3y ago
The Windows installer is 1/3 the size of the Mac one. It's just kinda surprising.

More ›