reaslonik

3 ms·

1.
by reaslonik 11mo ago
From the blog page at https://blog.mozilla.org/en/firefox/ai-window/ it looks like it's an explicit option to open a window with AI features and without, so you get a choice to enable the features if you
2.
by reaslonik 11mo ago
Of course, it's generally useful for things you can verify, which for acronyms is easy as long as you find the words
3.
by reaslonik 11mo ago
At least with their previous features it's been possible to set the address to any custom services you may have running, remote or local. For example Against all expectations I had I've actually found the highlight -> explain
4.
by reaslonik 11mo ago
One thing I find that constantly makes pain for users is assuming that any of these models are thinking, when in reality they're completing a sentence. This might seem like a nitpick at first, but it's a huge deal in reality: if y
5.
by reaslonik 11mo ago
I'm running the huggingface's .safetensors with vLLM with as little starting parameters as possible. I thought it must not be sending temp right, but after setting temp to something else I got chinese so it should be sending it. O
6.
by reaslonik 11mo ago
Breaks as in contains words that grammatically work but don't make sense, mistakes the symbol | for a person, points back to things that didn't exist in the request etc. I use templates like these for explaining questions: from ``
7.
by reaslonik 11mo ago
While impressive that the output isn't completely undecipherable, my real-world queries for SpringBoot project with most popular libraries don't compare so favorably to their benchmarks against Qwen3 32B, which I also run regularl
8.
by reaslonik 11mo ago
You need to leave much more room for context if you want to do useful work besides entertainment. Luckily there are _several_ PCIe slots on a motherboard. New Nvidia cards at retail(or above) are not the only choice for building a cluster;
9.
by reaslonik 11mo ago
>I can do whatever the hell I want from this M1 MBA in a hotel room in Japan. As long as it's within terms and conditions of whatever agreement you made for that $20. I can run queries on my own inference setup from remote locations