fzzzy

18 ms·

271.
by fzzzy 3y ago
How much ram do you have? How much gpu ram do you have? What gpu do you have? What kind of performance are you hoping to get in tokens per second?
272.
by fzzzy 3y ago
I'm using gguf q5 and I find the output degrades going to even q4. Mistral has said they still intend to open newer bigger models, so I'm really looking forward to that.
273.
by fzzzy 3y ago
You need computers for all of them and megawatts of power, power supplies, cooling, and power distribution.
274.
by fzzzy 3y ago
Have you tried miqu q5
275.
by fzzzy 3y ago
I'd like to try this, do you have some prompts you like to use for evaluation?
276.
by fzzzy 3y ago
I'm not responsible for whatever led the ml community to the widespread use of pickles for weights. It happened regardless of the warnings that pickles are dangerous. Yes, ml researchers have been running random pickles from the intern
277.
by fzzzy 3y ago
What? How do OpenAI and Antrhropic and Mistral API access contribute less to text pollution?
278.
by fzzzy 3y ago
Learning about the low levels, for one.
279.
by fzzzy 3y ago
I think a binary format is obviously the right answer here.
280.
by fzzzy 3y ago
I think the disconnect is that rockstar made a lot of noise about trying to eliminate crunch after the nightmare crunch of red dead redemption 2. So if they are making people go back into the office to force crunch out of peer pressure, the
281.
by fzzzy 3y ago
Yes. But many of those people are probably so proud of working on it and wouldn't want to stop. Also, rockstar did make an effort to cut back on crunch after red dead 2, so the result is longer timelines. R* going back to crunch probab
282.
by fzzzy 3y ago
I'm just saying working on gta 6 is not fungible, is all. I agree remote work is not a right, but for someone working on their dream project, the most advanced game in the world (arguably), it's probably not as easy as just going
283.
by fzzzy 3y ago
How many companies in the world are making gta 6?
284.
by fzzzy 3y ago
This is only true for models that are python pickles. gguf doesn't suffer from this. The ml community needs to move away from pickle files as soon as possible. Worst idea ever.
285.
by fzzzy 3y ago
Antitrust laws take decades to have an effect.
286.
by fzzzy 3y ago
That's a problem that companies worry about after they have it.
287.
by fzzzy 3y ago
The mixtral large marketing at the top of hn right now claims json mode and native function calling. I haven't tried it, but that's what they say.
288.
by fzzzy 3y ago
I don't think the fun part is actually pressing on the keyboard.
289.
by fzzzy 3y ago
In my experience, if I use github copilot chat as a natural language interface to programming it's basically flawless. That is, I tell it exactly what I want the code to he like but in english, and the llm just translates that into cod
290.
by fzzzy 3y ago
I know about the leaked prompts and the laziness issues, but haven't read the prompt. What specifically about the prompt changes do you feel have led to laziness?
291.
by fzzzy 3y ago
This seems to be a longstanding bug, I have many chats with the summarization in another language.
292.
by fzzzy 3y ago
Sure. I usually just use !x for that.
293.
by fzzzy 3y ago
Just always use !==. != will automatically cast and !== won't, therefore "1" != 1 is false and "1" !== 1 is true.
294.
by fzzzy 3y ago
What advice did Machiavelli have?
295.
by fzzzy 3y ago
Mozilla corp is not a nonprofit. Mozilla org is, but we'retalking about the ceo of the corp here.
296.
by fzzzy 3y ago
What exactly is obsolete about css? There are still valid use cases for float and inline block. border-box also fixes most of the teeth-gnashing from the 00s. I think it's a nice idea but I don't see what would get cut. Tables are
297.
by fzzzy 3y ago
put a faraday cage around your house lol
298.
by fzzzy 3y ago
Adrian does some mac stuff too.
299.
by fzzzy 3y ago
Is it 10 feet long?
300.
by fzzzy 3y ago
Max was started in 1985 but PureData wasn't until 1996.

More ›