pavelai

4 ms·

1.
by pavelai 2mo ago
LLMs are structurally incapable of abductive "jump" to formulate novel premises required to generate new theories. While they can deduct by using established premises to prove things
2.
Prompt Injection Vulnerability in Ollama, Gemma4 and HuggingFace's Transformers(reddit.com)
2 points by pavelai 2mo ago|1 comments
3.
by pavelai 2mo ago
Prompt injection allows third-party to inject a system prompt with simple message, by inserting special HTML-like sequence (details below). Some of the issues are well-known and pretty old (almost 2 years for Transformers library) Issues: •
4.
Demis Hassabis comments his departure on X(twitter.com)
2 points by pavelai 2mo ago|1 comments
5.
by pavelai 2mo ago
This small Klingon speaking language model was trained completely on ESP32. The training took 2 days Number of parameters: 319K (Disclaimer) The models is tiny and is not a pocket chatbot. It mistakes and is not capable to support conversat
6.
An SLM trained on $8 ESP32-S3(github.com)
67 points by pavelai 2mo ago|20 comments
7.
Kimi K3 for local use (1.56TB –> 594GB) compressed by Unsloth(huggingface.co)
7 points by pavelai 2mo ago|1 comments
8.
by pavelai 2mo ago
The model was quantized to 8, 4, 2, and 1 bit. Characteristics: • Q8: 8-bit 1.56 TB, lossless • Q4: 4-bit, 1.51 TB • Q2: 2-bit: 861 GB • Q1: 1-bit, 594 GB The smallest Q1 model keeps 78.9% accuracy, while being almost 3 times smaller than t
9.
Requential Coding <1 bit compression with better generalization(github.com)
2 points by pavelai 3mo ago|2 comments
10.
by pavelai 3mo ago
"We introduce requential coding, where a teacher model selects training samples drawn from the student's own distribution" Due to new learning technique the model has achieved better generalization skill without overfitting a
11.
by pavelai 6mo ago
There are plenty of them on Reddit
12.
HuggingFace has just released Transformer.js v4 with WebGPU support(github.com)
2 points by pavelai 6mo ago|1 comments
13.
by pavelai 6mo ago
Transformers.js allows you to run models right in the browser. The fourth version focuses on performance. The new version has support of WebGPU and it opens new era in browser-run models Here the demos on HuggingFace: https://hug
14.
by pavelai 10mo ago
While the idea is somewhat new for today's JS. And I see some benefits for this to make single-purpose servers compiled into tiny binaries. I believe it would take some time to make this popular. You should to find the niche where it&#
15.
by pavelai 10mo ago
You forgot to upload a python script or results described in the readme. Without it this is only an idea draft, not a proof of anything
16.
It’s time to free JavaScript (2024)(javascript.tm)
720 points by pavelai 10mo ago|367 comments
17.
by pavelai 10mo ago
Yep, this is one is a real hero in this list
18.
by pavelai 10mo ago
AtProto is a very unexpected choice to see here. Not because it's not good, but it's just very young. Why did you chose AtProto?
19.
by pavelai 10mo ago
Obviously it's * Docker * WASM * Rustlang * Web itself
20.
by pavelai 10mo ago
Hm... Why not to sell it or give to the community, if there is no intension in further work on the project?
21.
by pavelai 11mo ago
I think it's would be faster to build this as a Discord community and then to move to a dedicated app/service. It's too early to fix anything into a profession or term because things are changing too fast. And community would
22.
by pavelai 11mo ago
Omg, it was just right there. Thanks. These projects are incredible examples of developer creativeness. Wanna try it in a browser one day
23.
by pavelai 11mo ago
It would be merged into a valid code. What's about alignment in particular, I'm not sure
24.
by pavelai 11mo ago
MacOS one day?
25.
by pavelai 11mo ago
Builders will be there as long as people do programming. But it's the first step to move to better builders. Or to standard one? Also it helps to start with typescript faster and easier, and to make the learning curve smoother and main
26.
TypeScript is supported in all major JavaScript Runtimes since today(nodejs.org)
4 points by pavelai 11mo ago|2 comments
27.
by pavelai 11mo ago
If one of developers changed function name and the other changes alignment of parameters in the same line, this tool would recognize the changes and merge this line without conflicts. Regular git algorithm would turn it into a conflict beca
28.
by pavelai 11mo ago
Ok. We are talking about different things. There are fundamental rules which make technologies to strive or disappear. But there are other fundamental rules for products, features, etc. So you talk about products and I talk about technology
29.
by pavelai 11mo ago
Well, the history of software development shows that everything is changing and don't lasts forever. Golden age of SaaSes now is going to fade (at least for current version and for some time, maybe a decade). Today junior developers ca
30.
by pavelai 11mo ago
You can do a blog about retro programming to find clients which have your stack. I read about group of developers who were writing in Cobol in 2010s. Because this software were in use and still in use somewhere. The guy who wrote about it w

More ›