threeducks

11 ms·

121.
by threeducks 2y ago
Performance for text generation is memory-limited, so lack of native fp8 support does not matter. You have more than enough compute left over to do the math in whichever floating point format you fancy.
122.
by threeducks 2y ago
I agree. This benchmark should have compared the largest ~4 bit quantized model that fits into VRAM, which would be somewhere around 32B for RTX 3090/4090/5090. For text generation, which is the most important metric, the tokens p
123.
by threeducks 2y ago
The dangers of "model collapse" are wildly overstated. Sure, if you feed the unfiltered output of an LLM into a new LLM, inbreeding will eventually collapse the model, but if you filter the data with some grounding in reality, the
124.
by threeducks 2y ago
You could tag dynamically allocated objects with some magic bytes. To then check whether a string is dynamically allocated, you can simply compare the first few bytes against the magic bytes. This is a probabilistic method, but if you use e
125.
by threeducks 2y ago
> it was the first language that ever gave me compile error because there were cases that my switch statement didn't account for. For C, you can use the switch -Wswitch-enum with GCC to get warnings and add -Werror to turn the warni
126.
by threeducks 2y ago
Yes, but we could also give the LLM access to a Python interpreter and solve a much larger class of problems with correctness guarantees and around a billion times less compute.
127.
by threeducks 2y ago
Two reasons: 1. LLMs "think" in terms of tokens, which usually are around 4 characters each. While humans only have to memorize 10x10 multiplication tables to perform multiplication of large numbers, LLMs have to memorize a 10000x
128.
by threeducks 2y ago
I've had the opposite experience. An SSD died without any warning resulting in complete data loss, while a dying HDD started making funny noises, which prompted the thought "Hmm, might be time for a backup again".
129.
by threeducks 2y ago
I often hear that Krita has a different focus, but does it lack anything that GIMP has? (disregarding obscure features like bell pepper brush)
130.
by threeducks 2y ago
Ironically, their terms of service forbid the generation of copyrighted content.
131.
by threeducks 2y ago
Those testimonials are AI-generated and fake. For example, "Emma Davis" is this stock photo: https://picryl.com/media/girl-portrait-looking-people-c182c0 (Screenshot of website in case OP deletes it https:&#
132.
by threeducks 2y ago
The free Flux.1 Dev model with this LoRA can do it. https://civitai.com/models/794953/coloring-book-flux Here are a few cats (not cherry picked, no postprocessing): https://files.catbox.moe/5zpp78.
133.
by threeducks 2y ago
It boggles the mind how a $10 space heater has better overheating protection than this $4000 space heater.
134.
by threeducks 2y ago
Sorry, I don't have first-hand proof. But it seems that this issue is not rare: https://old.reddit.com/r/programminghorror/comments/4g70lj/s...
135.
by threeducks 2y ago
A common source of "NULL" strings are CSVs. I personally had to deal with a database that only understood NULLs correctly when using QUOTE_NOTNULL, which was added to Python just last year: https://github.com/pytho
136.
by threeducks 2y ago
Visual language models are quite good at converting images to LaTeX or any other kind of representation these days. Here is a demo where you can upload a screenshot of a page with an equation and ask the neural network to e.g. "Transcr
137.
by threeducks 2y ago
You can set PyTorch to deterministic mode with a small performance penalty: https://pytorch.org/docs/stable/notes/randomness.html#avoidi... Unfortunately, this is only deterministic on the same hardware, but
138.
by threeducks 2y ago
Less than half of HN users are from the US and wages are lower in most countries, sometimes by a lot. Less than 10% in Turkey or Ukraine for example: https://en.wikipedia.org/wiki/List_of_countries_by_average_w...