sjwhevvvvvsj

7 ms·

31.
by sjwhevvvvvsj 3y ago
It’s not fixed whatsoever. Mistral 7B runs on a MacBook Air, and it’s free. Zero cost LLM, no network latency.
32.
by sjwhevvvvvsj 3y ago
Yes but if a 7b LLM will give you the same “Hello World” as the 70b, and that’s literally all you need, using a bigger model is just burning energy for no reason at all.
33.
by sjwhevvvvvsj 3y ago
So I think that’s a “your problem isn’t right for the tool” issue, not a “Mistral isn’t capable” issue.
34.
by sjwhevvvvvsj 3y ago
Yes, but for certain classes of problems small LLM are highly performant - in many cases equal to a GPT-4, which sure can do more things well, but adding 2+2 is gonna be 4 no matter what. You don’t need a tank to drive to the grocery store,
35.
by sjwhevvvvvsj 3y ago
People think LLM are all or nothing, like it’s either god-like AGI or it’s useless “hallucinating”. In reality you have to know the strengths and weaknesses of any tool, and small/fast LLM can do a tremendous amount within a fixed scop
36.
by sjwhevvvvvsj 3y ago
Yup, and that’s the thing with the LLM craze - it’s super energy intensive and for the most difficult problems you still need really good hand curated data anyway. My point is more “we know how to do this already and it’s just a hard proble
37.
by sjwhevvvvvsj 3y ago
Who says it’s wrong? I have very discrete tasks which involve resolving linguistic ambiguity and they can perform very well.
38.
by sjwhevvvvvsj 3y ago
The loudest people have the least to say, but I think there’s a lot of smart use cases beyond variation on chat bots.
39.
by sjwhevvvvvsj 3y ago
#2 is just a document classification task, you can do it with DistilBERT.
40.
by sjwhevvvvvsj 3y ago
Hey now, Google paid very good money for that antitrust testimony.
41.
by sjwhevvvvvsj 3y ago
Usually somebody serving in an interim position doesn’t make big strategic changes.
42.
by sjwhevvvvvsj 3y ago
What Mistral has though is speed, and with speed comes scale.
43.
by sjwhevvvvvsj 3y ago
He’s first author on a ton of those papers. That’s a tenure worthy CV almost anywhere. Gimme a break.
44.
by sjwhevvvvvsj 3y ago
the answer is it’s a state sanctioned monopoly which concentrates control of advanced technological processes in the hands of NATO. ASML is a strategic asset.
45.
by sjwhevvvvvsj 3y ago
If AMDs version of “asleep at the wheel” is them eating Intels lunch for the last few years, I’d hate to see them awake. Intel is weak, and it’s much smarter to put resources into squeezing Intel while they are on the ropes than shift too m
46.
by sjwhevvvvvsj 3y ago
http://hyperreal.org/ :-)
47.
by sjwhevvvvvsj 3y ago
I was hoping for a Mistral fine tune at the least.
48.
by sjwhevvvvvsj 3y ago
This is a great way to encourage developers to build the app that will show an essential use case for the Vision Pro. It’s not like Vision Pro is a solution in need of a problem, desperately waiting for a killer app, or that apps built the
49.
by sjwhevvvvvsj 3y ago
Did anything come of that?
50.
by sjwhevvvvvsj 3y ago
Stadia was such a monumental technical achievement, it was painful to see how they killed it without even seeing what it could be used for. Idiocy.
51.
by sjwhevvvvvsj 3y ago
Looks like it may have been stadia related.
52.
by sjwhevvvvvsj 3y ago
Also the social safety net in NL covers a lot of things you have to pay for yourself in the USA.
53.
by sjwhevvvvvsj 3y ago
Yeah, and equal time spent futzing with your launcher is better spent tinkering with a raspberry pi or similar. At least then you may develop a skill. Android customization is sort of like junk food - enjoyable in the moment, but not meanin
54.
by sjwhevvvvvsj 3y ago
It’s not just media narrative. The culture was eroding for years, as you note, but the dam finally broke and they went full IBM/Kodak. Or in other words, “slowly at first, then all at once”.
55.
by sjwhevvvvvsj 3y ago
I think Google lost the top researchers when they destroyed the culture. All the competitor companies are mainly led by ex-Google talent, and honestly who in their right mind would take a Google job today over OpenAI, Mistral, or even Meta
56.
by sjwhevvvvvsj 3y ago
“Your work”, is their “content”.
57.
by sjwhevvvvvsj 3y ago
And then you can double dip with a little drop shipping on the side.
58.
by sjwhevvvvvsj 3y ago
Don’t hate the player, hate the game.
59.
by sjwhevvvvvsj 3y ago
Ruth approves.
60.
by sjwhevvvvvsj 3y ago
In all honesty, at the rate LLM coding ability is increasing I am not sure how many entry level roles will be left for people who don’t have a solid grounding in computer science. Generally speaking, I believe this is a bad thing as coding

More ›