Zambyte

59 ms·

931.
by Zambyte 2y ago
This was very wholesome, thanks for sharing :)
932.
by Zambyte 2y ago
FWIW I'm getting 29 TPS on Ollama on my 7900 XTX with the 27b qat. You can't really compare inference engine to inference engine without keeping the hardware and model fixed. Unfortunately Ollama and vLLM are therefore incomparabl
933.
by Zambyte 2y ago
Here are the direct links: https://ollama.com/library/gemma3:27b-it-qat https://ollama.com/library/gemma3:12b-it-qat https://ollama.com/library/gemma3:4b-it-qat https:/
934.
by Zambyte 2y ago
The significant convenience benefits outweigh the higher TPS that vLLM offers in the context of my single machine homelab GPU server. If I was hosting it for something more critical than just myself and a few friends chatting with it, sure.
935.
by Zambyte 2y ago
I ask why because tons of other software achieve being free to use, free of charge, without preventing the software from being commercialised by a third-party. Why do they feel the need to prevent their software from being commercialized? T
936.
by Zambyte 2y ago
appears, like
937.
by Zambyte 2y ago
How was that surprising? The parrot literally said "I'm a pretty parrot" and the model was like "wait, you're a parrot?" I would have been more surprised if it didn't proceed treating the caller as a parro
938.
by Zambyte 2y ago
Thanks, I honestly tried looking for that, but I couldn't find it.
939.
by Zambyte 2y ago
They've been around for years now. Obviously not as long as the others, but years nonetheless. What makes you think the years so far may not continue into the future? The only pattern I can see is it being potentially unsustainable, bu
940.
by Zambyte 2y ago
Just because you don't like LLMs doesn't make them not revolutionary with regards to how people use computers.
941.
by Zambyte 2y ago
Yep. A closed set of core language designers who have exclusive right to propose new paths for the language to take while developing fully Free and in the open is how Zig is developing.
942.
by Zambyte 2y ago
What product? They aren't selling anything. Like at all.
943.
by Zambyte 2y ago
> Prevent the Defold software from being commercialised by a third-party. Why?
944.
by Zambyte 2y ago
Dare I ask why?
945.
by Zambyte 2y ago
Maybe they would (different games foster different cultures). Maybe they'd use it as a starting point and derive something more friendly.
946.
by Zambyte 2y ago
The person in possession of an expired ID can quite easily change, yeah.
947.
by Zambyte 2y ago
That doesn't answer the question of why.
948.
by Zambyte 2y ago
For redirects I like to create a rule to direct versioned sites (like documentation) to either "latest" or the version relevant to me. I also like to redirect sites to a more user friendly version when applicable (like reddit.com
949.
by Zambyte 2y ago
Just typed this up elsewhere in the thread: https://news.ycombinator.com/item?id=43726582
950.
by Zambyte 2y ago
I paid for both for close to half a year to see which one I wanted to keep. I decided to drop Perplexity in favor of Kagi, because Perplexity felt like it was trying to position / portray itself as a supernatural-esque Source of Truth,
951.
by Zambyte 2y ago
Related: https://en.wikipedia.org/wiki/AI_effect
952.
by Zambyte 2y ago
I would love action to be swift and simultaneous.
953.
by Zambyte 2y ago
I do red teaming for a competition in an educational environment. A lot of it involves writing custom malware for the environment. All these "safety nets" suck, because they stop the models from helping me with my work for no good
954.
by Zambyte 2y ago
Between Bandcamp, 7digital, and Amazon (which I check in that order), I have always been able to find anything I was looking for.
955.
by Zambyte 2y ago
Ah. I'm using the Kagi interface, which doesn't let you set the system prompt afaik.
956.
by Zambyte 2y ago
Hm, I tried it with nano, mini, and standard, but it didn't work for me.
957.
by Zambyte 2y ago
The people moaning are the ones building things that can be built better, not the ones that you should try to sell to.
958.
by Zambyte 2y ago
What? If the connection was real, why would I limit it to a public digital timeline? That seems like that would be performative. Kinda over picking apart my relationship with people on Bluesky. Just wanted to share that I have been really
959.
by Zambyte 2y ago
My trusty local files from bandcamp, 7digital, and amazon have yet to fail me.
960.
by Zambyte 2y ago
Ah, my bad

More ›