npodbielski

7 ms·

31.
by npodbielski 3mo ago
I always wonder why author of such software will not add some screenshot or gif showing UI and how it does work? In features there is mention of web interface.
32.
by npodbielski 3mo ago
Rig with 6x RTX 5090. I would not say it is RAM only
33.
by npodbielski 3mo ago
Policy influence idea: find out who are the assistants of policians and what ai assistant, subscription they use and give them different answers than to everyone else. You do not have to even corrupt them.
34.
by npodbielski 3mo ago
No Qwen 3.6? Why?
35.
by npodbielski 3mo ago
ah that makes sense now! I must be tired...
36.
by npodbielski 3mo ago
So Y Combinator signed it too? But this is HN, Y combinator website. I think I am missing something because I never read any opinion like 'we should ban Chinese models'.
37.
by npodbielski 3mo ago
Really hard game for someone that is non native. Or maybe I am just at scrabbles?
38.
by npodbielski 3mo ago
Sure I understand though, I have honestly no idea what tauri is really. Sure there is a link and it looks like some kind of web framework. Looks nice but it is hard to picture how chat application written with that would look like. I am not
39.
by npodbielski 3mo ago
Interesting but could you put few screenshots there? Of both desktop and mobile? It is really hard to invest time into installing something that you cant see anywhere prior, and it will be really easy to do for someone that is using it dail
40.
by npodbielski 3mo ago
Ah mobile app is not ready yet. I am looking for some alternative to matrix because running it with bots is a bit convoluted, i.e. you have to have limit of edits of message for model streaming or you will kill entire room. Or I never seen
41.
by npodbielski 3mo ago
Ah past renewal... So probably in next contract there will be a lot of thinking if we still need that. Curious: Anybody have comparison what is the difference when company is changing to token based billing? How many times it is bigger than
42.
by npodbielski 3mo ago
Strange. This is what they got at my company. I do not remember anyone mentioning paying for tokens. Maybe because it is fairly small, couple of hundred people in IT.
43.
by npodbielski 3mo ago
So just a mobile wrapper on agents running on some machines?
44.
by npodbielski 4mo ago
I added repetition penalty of two. I do not know. Maybe it is not applied correctly somehow by llama swap, that I am using, but I do not consider it that much of a nuisance to so I did not tried to fix it yet. Do you have this DRY docs?
45.
by npodbielski 4mo ago
Yeah but 4 bits very often loops needlessly. Which is not that bad because you do not pay for tokens. But you paid for hardware and you want use it for something useful. Q6 is better but then you have like 40t/s prefill. Which is reall
46.
by npodbielski 4mo ago
I like vibe and pi. Vibe just looks nice and is good enough. But pi extensibility is just another level. There is also Dirac that is quite OK but seems like full of bugs. Zerostack is the simplest harness I saw. OpenCode is OK too. Rest I d
47.
by npodbielski 4mo ago
How? If something like that would happen robots would be disabled in 5 minutes.
48.
by npodbielski 4mo ago
What is wrong too? The plan to create a lot of cheap models? That it is what is happening but it is bad plan? Or the opinion that it is what is happening but it is wrong opinion because they do not plan to do that but i.e. China is just bi
49.
by npodbielski 4mo ago
Interesting take. One question though: is it even possible for US companies? I am not so sure. Investors put a lot of money in those companies and they expect return. Doing nothing for 6-12 months waiting for China would probably make a lot
50.
by npodbielski 4mo ago
And how does it relate to Medium?
51.
by npodbielski 4mo ago
What?
52.
by npodbielski 4mo ago
Sure I am not disputing that. But we can't say that z.ai is profitable because they charge the same as other providers per token. There is also training cost. And reaserch cost. Just inference is not all. Maybe there are profitable wit
53.
by npodbielski 4mo ago
And how you do know that GLM is not subsidised? Maybe Chinese government is burning money to destroy US economy by making them lose money in AI companies that are just furnace burning dollars. Unless you have some compelling argument it is
54.
by npodbielski 4mo ago
This would probably became very true if we would stay with the current prices of 'AI'. Will we? Open AI is not profitable. Anthropic says that they may have profitable quarter. If they will raise prices will it still be the case
55.
by npodbielski 4mo ago
Who they employ then? AI?
56.
by npodbielski 4mo ago
unsloth version works.
57.
by npodbielski 4mo ago
Touche!
58.
by npodbielski 4mo ago
I tried to run it but seems like it is either broken or it does not work on dockerized llama.cpp: 0.01.865.326 E llama_model_load: error loading model: missing tensor 'blk.40.attn_norm.weight'
59.
by npodbielski 4mo ago
Do you really believe that? If I would be employer or manager of developers saying that they need to carefully design whole system for the agent to implement, so not a technical person, it would look like their are buying their time. I beli
60.
by npodbielski 4mo ago
Only the Sith deal in absolutes

More ›