Roxxik

5 ms·

1.
by Roxxik 6d ago
I mean this is what MoE is the first step of. Slice your intelligence to make it more efficient without losing much capability. CUA seems to disaggregate. Train specialist models and make delegation explicit. But I think the future for capa
2.
by Roxxik 2mo ago
I'd say recreating an existing website as is, is the easier task. Doing a look alike, even if the models do take some shortcuts on the way is doable right now. You have a template frontend to compare to. Now if it would scale to the nu
3.
by Roxxik 3mo ago
My recommendation if you are willing to push it further is to keep KV and always needed weights pinned in memory, so they do not get evicted. This is likely already the case, as they are touched on each token. mmap is slow on evicted pages,
4.
by Roxxik 3mo ago
Not sure if mmapping is the right way. In my own tests I noticed that simple mmapping will produce many small reads and not keep the SSD queue saturated. So if RAM is large enough to cache most experts, that is a rounding error. But if the
5.
by Roxxik 3mo ago
I have prototyped something similar with ollama some months ago. Do you mmap or issue reads on demand? Also do you use io_uring to interleave compute with io or do you spawn extra threads? I also tried predicting which experts get reused an
6.
by Roxxik 6mo ago
IO is very bursty in these setups. When the router results are in you can start loading experts from SSD. In this brief moment the SSD is saturated. Outside of that the SSD is idling. Table 3 shows for K=4 experts an IO of 943 MB/Tok
7.
by Roxxik 6mo ago
Does an SSD meaningfully degrade by read only workloads?
8.
by Roxxik 6mo ago
Not only you understanding the how, but you not understanding the goal. I often use AI successfully, but in a few cases I had, it was bad. That was when I didn't even know the end goal and regularly switched the fundamental assumptions
9.
by Roxxik 1y ago
I also tried myself, on different array sizes, with more iterations. The branchy version is not strictly worse. https://gist.github.com/Stefan-JLU/3925c6a73836ce841860b55c8...
10.
by Roxxik 2y ago
They are explicitly not assuming anything about the content of the auxiliary space (full hard drive). So the data might be incompressible and thus compressing it and restoring it afterwards would not work. Edit: From the paper: > One nat
11.
by Roxxik 2y ago
So the trick is to do the computation forwards, but take care to only use reversible operations, store the result outside of the auxiliary "full" memory and then run the computation backwards, reversing all instructions and thus u
12.
by Roxxik 2y ago
I'm not sure that the analogy stretches so far. What even is an artificial neuron in an Artificial Neural Network executed on "normal" (non-neuromorphic) hardware? It is a set of weights and an activation function. And you ev
13.
by Roxxik 3y ago
I think it is a little unusual, but nothing unheard of. I started as a junior IT Consultant in Hamburg, Germany with a 3 month notice, but could only quit every half year. So for quitting at the end of june I had to give notice in march, an
14.
by Roxxik 8y ago
This looks like german to me, but i haven't ever seen these words used together. I thought it might be some old german and googled it, but searching "bewunderungeifersucht" just yields your comment and "bewunderungseifer
15.
by Roxxik 8y ago
minimally corrected google translation of the (short) article: Lidl is wasting 500 million euros Because the introduction of a new data system did not work out, Deutsche Post already had to record a high loss several years ago. The same thi
16.
The Return of Coppersmith’s Attack [pdf](acmccs.github.io)
2 points by Roxxik 9y ago|0 comments
17.
by Roxxik 9y ago
had a kernel panic once, i think it was some 9.x, when unplugging a mounted usb stick (oops)
18.
by Roxxik 9y ago
Just started to copycat your code to rust, not yet finished, continuing tomorrow https://github.com/Roxxik/ping_ether/blob/master/src/main.rs
19.
by Roxxik 9y ago
documentation says it all: "bytes address; // BE encoded 4-byte or 16-byte address (size determines ipv4 vs ipv6)"[0] [0]: https://github.com/ethereum/devp2p/blob/master/rlpx.md
20.
by Roxxik 9y ago
Just today I started to look into RLPx to do some basic network discovery, so your guide is quite nice to have as a reference. But I had some difficulties getting started, because the RLPx spec was not simple to find (ethereum wiki -> de
21.
by Roxxik 10y ago
It shouldn't be that difficult to write some simple compiler to translate a scripty language that looks like awk to BPF-Assembly (or C and stuff that into LLVM). I might look into this stuff for my Bachelor Thesis ;)
22.
Modern Functional Programming: The Onion Architecture(degoes.net)
283 points by Roxxik 10y ago|95 comments
23.
by Roxxik 10y ago
I was just thinking about writing a minimal traffic-analyzer and libpnet looks way more suitable for this task than libpcap. And adding the functionality for a pcap like fileformat doesn't seem that difficult. The filters are a major p
24.
by Roxxik 10y ago
> To run Spyglass, you need extra permissions above that of a normal user in order to capture network traffic at the data-link layer, below IP, and without having to alter or interfere with the regular data flow between the client app an