xlayn

5 ms·

31.
by xlayn 2mo ago
The unsloth Q8kxl https://huggingface.co/unsloth/Qwen3.8-27B-GGUF for some reason is looping and going crazy on the think part (I tried to search for an email to let the guys know but didn't find one)... I used t
32.
by xlayn 2mo ago
The file "Just loads" on llama.cpp, the Unsloth https://huggingface.co/unsloth/Qwen3.8-27B-GGUF is an MTP file, I see mostly the same speed on pp and generation. There has to be something wrong with those ben
33.
by xlayn 2mo ago
Absolutely agree, and yes AI is an slop-enabler tool.
34.
by xlayn 2mo ago
So if you take any of the options above, and as part of the instructions mention to be more concise, push to github, and then the reader is lazy and don't verify, is it slop? Hey option d, please create a website to sell stuff similar
35.
by xlayn 2mo ago
So the issue it's then the lack of polishing, intention, drive, which again in every case of my list is the same irregardles of who does it. On the other hand if there is no AI involved, but as another comment here mentions, before ai
36.
Ask HN: What's slop? what's AI written text and why read/not read?
7 points by xlayn 2mo ago|7 comments
37.
by xlayn 2mo ago
This should be the top comment, the implication is: AI will decide if AI is correct or no, so adding a new layer of approval... Whenever you say, hey that's incorrect, the legal process goes to AI and will decide on that issue... Will
38.
by xlayn 2mo ago
We have totally come out with this idea of this index that will allow us to create policies to ensure only the best and safest AIs are used by the public.... Absolutely no conflict of interest, no lobbying here And no this is not related to
39.
by xlayn 2mo ago
this is a really new account with 6 of Karma, why does the owner of a company spending $4k come to talk about the 27B model useful just get you the weather? companies went south on token usage, and the default for copilot AFAIK is like 40
40.
by xlayn 2mo ago
I wonder besides big labs and REALLY big corporations who can run the 2.6TB q8... I mean, the 1 bit one is 508GB. Assuming 256k context size as irrelevant at those sizes, I would need 22 AMD 7900XTX (24GB vram) to run this for the 1 bit one
41.
by xlayn 2mo ago
People who argue against AI are the same people arguing against the car because of horses... This is going to open a whole field of jobs for... ... ...... someone... but let's not go into those details... Remember that this is going t
42.
by xlayn 2mo ago
Assumming it's true, half a cup of rice and tortillas it's a formula for a lot of nutrients deficiency + lack of proteins make the body start pulling it from muscles in order to repair other tissues.
43.
by xlayn 2mo ago
I have see a lot of "run <gigantic llm model name here> using cpu" or using 1gb of ram... and the short answer is sure, you can run it in 1mb of ram, or in a 286, it will just take a couple of years to produce the first toke
44.
by xlayn 3mo ago
Let's make the whole working/colaborating environment a training input for the model, we have to replace each and every link of human everywhere, think about the stock prices... yes it will have cathastropic consequences to succee
45.
by xlayn 3mo ago
get your eyesight check, at some point in life I was having difficulties staying focus and even started having headaches... and I needed prescription glasses... Also very important, try to sleep the best you can and do exercise... I remembe
46.
by xlayn 3mo ago
I would like to argue that trying to provide a free service is non achievable, most of the time it will drill down to ads, people are already paying electricity and time in ads. If we pay say 3 secs of compute time of monero, and everyone p
47.
by xlayn 3mo ago
X402... I was not aware, I had this idea of making HTTP connection depend on a monero transaction, the monero transaction should take around 3 secs of the average computer/cellphone... once you have paid that you can access the resourc
48.
by xlayn 4mo ago
because we need quadratic energy increase to increase speed linearly, that's why a 200hp car is not twice as fast as a 100hp one. Gee let me elaborate a bit more... if the 100hp car has a top speed of 100mph, a 200hp car will have mayb
49.
by xlayn 4mo ago
I want to rush to git clone, but as things are, the odds are extremely high that this kind of things that are too good to be real are honeypots and something there will compromise your machine or make your llm start working for someone else
50.
by xlayn 4mo ago
Another perspective, if you compare it to two years ago, how much more expensive is it and how much better? we are paying the sAIm Taxltman. Just see, you could buy the steam deck for 250 refurbished 2 years ago, now it's what 700$? Tr
51.
by xlayn 4mo ago
I created a patch for llama.cpp to store on disk instead of deleting the kv cache as well as the checkpoints... there is this bug on llama.cpp if you have more than one instance going on of chats... and that causes the kv cache to be lost b
52.
by xlayn 5mo ago
I hope someone at jetbrains with enough power read what we are saying in this thread.... changes for the sake of changes are bad... when they did the change to the "new UI" I kind of stomach it.. because the option to go to the ot
53.
Copilot "auto-pilot" system instructions making models worst
2 points by xlayn 5mo ago|0 comments
54.
by xlayn 5mo ago
Ohhhh geee!!! I just applied the patch to my local git copy. You need to use the model on the PR that he submitted, the model is particular because it has extra information that allows the MTP to happen. I have two amd gpus, and qwen3.6 27B
55.
by xlayn 6mo ago
If anthropic is doing this as a result of "optimizations" they need to stop doing that and raise the price. The other thing, there should be a way to test a model and validate that the model is answering exactly the same each time
56.
AMD GPU LLM Performance Testing(github.com)
4 points by xlayn 6mo ago|1 comments
57.
by xlayn 6mo ago
I had a 6950 on my pc from when I built the thing... and then bought the 7900 for $5xx, that allows me to run more models, and then I saw the "Radeon AI PRO" and after a couple of frustrating talks with certain LLM to try to get a
58.
by xlayn 7mo ago
I updated the results, with just the Devstral part, but ran the full suite for it, and posted all the results file as well as a script to re-run the process. The results are more spectacular... The model pointed way better in gsm8k, but los
59.
by xlayn 7mo ago
Fair point on the writing style, I used Claude extensively on this project, including drafting. The experiments and ideas are mine though. On the prior art: you're right that layer duplication has been explored before. What I think is
60.
by xlayn 7mo ago
You can check here the results for Devstral, speed limits me, but these are the results for the first 50 tests of the command # Run lm-evaluation-harness lm_eval --model local-chat-completions \ --model_args model=test,base_url=

More ›