hoppp

19 ms·

571.
by hoppp 1y ago
I also just so checkbox in a txt file like: [X] Task 1 [] Task 2 Its enough for me
572.
by hoppp 1y ago
256 GB/s memory bandwidth is low but it still does around 40 tokens per sec with gpt-oss, good enough for local apps
573.
by hoppp 1y ago
There are use-case for smaller models that fit in 20gb VRAM, like in database sentiment analysis and such.
574.
by hoppp 1y ago
Hetzer already offers dedicated GPU servers from 180eur/month
575.
by hoppp 1y ago
I am thinking of migrating all my code from there to self hosted. If now github is part of the Ai team at microsoft then I really don't want to give them more of my code as Im kind of moving on from open source to making projects close
576.
by hoppp 1y ago
I am looking forward for the AMD 395 max+ PCs to come down in price. The inference speed locally will be acceptable in 5-10 years thanks to those generation of chips and finally we can have good local AI apps.
577.
by hoppp 1y ago
"AI-written code is arguably better, often with more comments and docs, humans would understand it faster anyway" Strongly disagree, AI is often confidently wrong and leaves bugs all over the place. With human code you know at lea
578.
by hoppp 1y ago
Solo sailing liveaboard coder here also. High five!
579.
by hoppp 1y ago
Cloudflare is a man-in-the-middle company. It has benefits to use them, but yes they are not a CDN in a traditional sense, they do much more.
580.
by hoppp 1y ago
You download the html, hash it with sha512 , then run the Ai and the webscraping and cache the api content When the cache is invalidated you refetch the html, check the sha512 hash to see if anything changed then proceed based on yes or no
581.
by hoppp 1y ago
The royal family is not above the law. They are just above people
582.
by hoppp 1y ago
Ecosia seems to be returning mostly sponsored hits and its hard to find things with it. I will always prefer duckduckgo
583.
by hoppp 1y ago
Charismatic people can get away with many things, refering to the fake id
584.
by hoppp 1y ago
Because its from microsoft so its compatible with word
585.
by hoppp 1y ago
Yes its an accident waiting to happen Eventually they will get hacked
586.
by hoppp 1y ago
I gravitated choosing the longer answer so my result was a preference for GPT5 responses
587.
by hoppp 1y ago
The chatgpt free tier doesn't seem to expire unlike claude or mistral ai, they just downgrade it to a different model
588.
by hoppp 1y ago
If its 5 seconds maybe you are better off renting a GPU server and running the inference where the data is, without round trips and you can use gpt-oss
589.
by hoppp 1y ago
They gonna release new models like apple releases iphones, same stuff little tweaks and improvements.
590.
by hoppp 1y ago
Yea but the cost is not a fixed monthly sum and things can go wrong as we can see from the blog post. An accident could bankrupt the dev. A dedicated server will always cost the same so you always know how much you pay. It will cost 40 Euro
591.
by hoppp 1y ago
It would cost a lot. Hetzner is hardware and them you can hammer it, free bandwidth. You get a very good server for cheap. cloudflare would be pay per request, a hefty sum if ddos happens
592.
by hoppp 1y ago
Cool... You did well to ban them. Its a ddos attack, lucky you dont have to pay for the brandwidth, then its a denial of wallet
593.
by hoppp 1y ago
It was an example I only use what I need, plain and simple, and its free yup, works local too. Llms suck at large projects, so I break it down to small simple things, what I wrote is an example of a small thing, I keep the tasks that large.
594.
by hoppp 1y ago
Seems to work :)
595.
by hoppp 1y ago
I would buy it to try to deploy code on it, just cuz I can connect via usbc
596.
by hoppp 1y ago
If you are amateur it better to do your time and not use ai tools for a while. It will make you much bette at development to learn like a senior dev did today
597.
by hoppp 1y ago
Sometimes its faster I write it, sometimes its not. I prompt like: give me go structs for this json "pasted json" and write 2 functions to save it and load it from "nosql db I use" That basically speeds up writing glue c
598.
by hoppp 1y ago
This is how I do it. Instead of writing a large amount, I just make it generate one function at a time. I dont want it to replace me, I replace reading the docs and googling or repetitive tasks. Its a hit or miss sometimes but I get to revi
599.
by hoppp 1y ago
Claude code is good but it often gives me too much result, if I dont tell it to give me just the answer I tried mistral and the code is often buggy Chatgpt is a good middle ground All free tier only
600.
by hoppp 1y ago
It probably loads the entire model into ram at once while ollama solves this and does not, it has a better loading strategy

More ›