rsolva

6 ms·

31.
by rsolva 4mo ago
Nowadays I use our local setup 95% of the time, but it is not that long since that flipped for me personally. Context: I have a $20 Claude Code subscription, and have used it for a handfull of small-ish projects the last year, in parallel w
32.
by rsolva 4mo ago
I have experimented with both q8 and q4 for KV cache. I can't find any difference between q8 and fp16, but q4 suffers more when the context grows. q8 seems like a good compromise and gives us enough ctx for about 6-8 concurrent, full c
33.
by rsolva 4mo ago
In our company of 24 employees, we get by with two DGX Sparks. We don't use AI heavily, but each Spark can serve about 6-8 concurrent requests with a full context lenght of 256k, which is decent. We get about ~35 t/s depending on
34.
by rsolva 5mo ago
Haha, not what I meant to write, but this works too!
35.
by rsolva 5mo ago
I remember using some kind of software around the time of windows xp i think, that could replace the chrome/shell so you could design your own GUI entirely – but I can't remember what it was called! I spent a lot of time iterating
36.
by rsolva 5mo ago
Can it summarize text it fetches? Come to think of it, this could be a nice model to have as the first pass in a more complex agent system where Needle hands of the results of a tool call to a larger model. I will defiantly play around with
37.
by rsolva 5mo ago
This is the way! It is incredible how far you get with a single HTML-file, containing styles and JS, when building dashboards, small apps and other utilities that can interact with an API or otherwise fetch data from somwhere. I just drop i
38.
by rsolva 5mo ago
Knowing both Norwegian and Dutch, most words here is surprisingly similar to modern words: hefenricæs = himmelrikes (no) uerc = werk (nl) eci = evig (no) / eeuwig (nl) ærist = eerst (nl) barnum = barn (no) sceppend = schepper (nl) EDIT
39.
by rsolva 5mo ago
I can recommend the VW e-UP!s from 2013-2016ish. They have very little tech in them but are relatively modern. You can also quite easily tap into the control systems (climate etc) to remote control it with your own hardware: https:/&#
40.
by rsolva 5mo ago
I have the same GPU and get very good results, even better than Gemma 4 26B A4B, using the following setup (Fedora 43 Silverblue, podman compose): services: llama: image: ghcr.io/ggml-org/llama.cpp:server-vulkan
41.
by rsolva 6mo ago
I run this model on my AMD RX7900XTX with 24GB VRAM with up to 4 concurrent chats and 512K context window in total. It is very fast (~100 t/s) and feels instant and very capable, and I have used Claude Code less and less these days.
42.
by rsolva 6mo ago
Laptops and tables are, as it turns out, not so cheap either. They need to be fixed or replaced at an alarming rate, and they lay claim to a much larger part of a school budget than books ever did. That is part of the reason that we revert
43.
by rsolva 6mo ago
Nifty, looks like the enterprise edition of OpenClaw, kinda. Also, it looks token hungry!
44.
by rsolva 6mo ago
The term 'social media' has changed a lot over time. The attention grabbing kind we have today is a very different beast than what we started out with; no ads and only a chronological timeline showing posts from your network. The
45.
by rsolva 7mo ago
It is not only about raw power consumption. Comparing driving an electric car with using AI only in kW hides a major point: Hyperscale datacenters are massively centralised, which brings it's own problems; a lot of energy is used for c
46.
by rsolva 7mo ago
Great ad. Long, but great.
47.
by rsolva 7mo ago
I run my own instance at home. Not everybody can do this, but if more nerds hosted instances for friends and family, it would get us somewhere at least :) The goal is not instant world domination, but a organically grown network, providing
48.
by rsolva 7mo ago
It is modular and built to be adapted to the different needs of online communities. They also have a more fine-grained boundaries system that allows to post only to pre-defined groups (or Circles in Diaspora / Google+ lingo) etc. I don
49.
by rsolva 7mo ago
I was thinking about social networks that is not Facebook. The challenge is to make something that can compete in this respect. It would be so nice to have the in-person part, but without the ads, scams, data theft and blackbox algorithms!
50.
by rsolva 7mo ago
I would like to see social networks that facilitates real life, face-to-face encounters to a much larger extent that the current state of affairs. The Fediverse has the pieces to this puzzle, but I do not know of one project that combines t
51.
by rsolva 7mo ago
Ban personalized advertising!
52.
by rsolva 8mo ago
Just write up your requirements in and AGENT.md, to avoid repeating yourself. It has worked really well for me on a PHP+Apache project.
53.
by rsolva 8mo ago
I have had the same experience when building simple websites for myself and others. I did it as a test to begin with, but it worked out so well that I have kept at it for a while. The core concept for my experiment was to have no dependenci
54.
by rsolva 8mo ago
@criomsoneer: Check out Open Science Network (Bonfire), they are also doing interesting work in this space! https://openscience.network/
55.
by rsolva 8mo ago
From the graphs on downdetector.com, it seems like many other services are affected too, so I guess some underlying infra has trouble?
56.
by rsolva 8mo ago
Do not expect your rights to be honored on large platforms. They are fenced gardens regularly weeded, using algorithms with very specific preferences. The only information outlet where we can have a reasonable expectation of freedom is the
57.
by rsolva 8mo ago
GNOME generally seem to have struck a nice balance over the years. Icons has a reasonable amount of skeuomorphism without too much hyperdetailed textures, most icons has distinct shapes (not just a bunch of boxes with rounded corners). I us
58.
by rsolva 8mo ago
Woah, I'm impressed! The voice cloning also worked much better than expected! Will there be separate models for other languages? I know the National Library in Norway has done a good job curating speech datasets with many different dia
59.
by rsolva 9mo ago
What is your definition of democracy?
60.
by rsolva 9mo ago
Centralisation generally leads to efficiency, but when pushed to far it will corrode core human values. Democratic processes will always have to contend with the messiness of humans, and we have to find a balance. Currently I feel the conso

More ›