jxy

7 ms·

31.
by jxy 2y ago
Macbook trackpads work fine combined with control/option/command as three buttons. I put the metal screen for devdraw together initially. It should work similarly on X11, though I never tried.
32.
by jxy 2y ago
> if you do a lot of near-work it can think you are still hyperopic, causing further myopia progression. Does this mean we should let our eyes see blurred images so our eyes would feel like they are seeing far away stuff and stop axial e
33.
by jxy 2y ago
No prompt length? For practical purposes, the prompt processing time would far more important.
34.
by jxy 2y ago
This inductive logic is way overblown. > Incredible, beat Llama 3 8B with 3.8B parameters after less than a week of release. Judging by a single benchmark? Without even trying it out with real world usage? > And on LMSYS English, Llam
35.
by jxy 2y ago
it may not be practical given the possible high latency.
36.
by jxy 3y ago
It's "Command R+". "Command R" is a smaller model.
37.
by jxy 3y ago
FLAN-T5-XL, a 3B model, to be precise.
38.
by jxy 3y ago
A more level-headed report with less fluff from the economist: https://www.economist.com/science-and-technology/2024/04/02/... https://archive.ph/rdxhb
39.
by jxy 3y ago
Probably try to implement a much better integrator. Some energy preserving higher order integrator should serve a lot better.
40.
by jxy 3y ago
How did you run whisper.cpp? Can you share the command line? What machine did you use to run that benchmark figure?
41.
by jxy 3y ago
I wonder if they messed with the scale or they messed with the bars.
42.
by jxy 3y ago
So some parts of it copied from Claude: https://news.ycombinator.com/item?id=39649261
43.
by jxy 3y ago
The previous blog post [0] mentioned they were using stockfish with 0.1 seconds per move. [0] https://adamkarvonen.github.io/machine_learning/2024/01/03/c...
44.
by jxy 3y ago
If you ever used w3m, it uses a local bookmark file. Something like this: $ cat ~/.w3m/bookmark.html <html><head><title>Bookmarks</title></head> <body> <h1>Book
45.
by jxy 3y ago
curiously, what real world usage actually uses FP4? AFICT, most of the LLMs still use BF16, and even the quantizations down to 4bits and 2bits end up back to 16bit or INT8 for actual computations.
46.
by jxy 3y ago
Apple's in-house map stumbled badly at the beginning. Apple has been using Google search since the very beginning. It's reasonable that if we can't run a gpt-3.5 level model on a macbook air for 20 hours without charging, it&
47.
by jxy 3y ago
OpenAI still seems to be at the top, except for Anthropic, who may be close, in terms of the capabilities comparing gpt-4 and claude-opus. This Grok-1 is a large model (~314B), which matches gpt-3.5 released 2 years ago, and at about the sa
48.
by jxy 3y ago
Can we stop this kind of misinformation? Training a model to map a token to individual letters are no harder than training a model to be fluent at English. Arithmetics with small number of digits are achievable as well. You can just try a s
49.
by jxy 3y ago
She stated "Let me break it down." Did she break it down somewhere? How can we see it without X account?
51.
by jxy 3y ago
http://git.9front.org/plan9front/plan9front/HEAD/sys/src/lib...
52.
by jxy 3y ago
It's much clearer if you read one of the source code of the libm. Plan 9: https://9p.io/sources/plan9/sys/src/libc/port/sin.c Freebsd: https://cgit.freebsd.org/src/tre
53.
by jxy 3y ago
The value of Intel's oneAPI tool chain is that you can write code that runs on their GPU, much like Nvidia's cuda or nvhpc.
54.
by jxy 3y ago
> There is a workaround: I installed the compiler using the same command on my WSL Actually you only need to have a relatively complete linux under /compat/linux. You could even chroot into that and do the oneapi install. The t
55.
by jxy 3y ago
> welcome Stephen Wolfram to Kagi’s board of advisors This is interesting. I guess we will soon read a longwinded post about it from the first person perspective.
56.
by jxy 3y ago
The matrices (weights) are ternary. The vectors are not.
57.
by jxy 3y ago
Yeah, 4bit would take 35 GB at least. 16bit would be 140 GB. I'm more interested in how Phind is serving it. But I guess that's their trade secret.
58.
by jxy 3y ago
How many H100 GPUs does it take to serve 1 Phind-70B model? Are they serving it with bf16, or int8, or lower quants?
59.
by jxy 3y ago
So that 3-4 mins at 1FPS means you are using about 500 to 700 tokens per image, which means you are using `detail: high` with something like 1080p to feed to gpt-4-vision-preview (unless you have another private endpoint). The gemini 1.5 pr
60.
by jxy 3y ago
> architectures like RWKV, Mamba, and various others, which incur cost that is linear in context length, O(N) These are actually O(N*M) where M is independent of inference time context length, but it controls the actual amount of informa

More ›