searealist

5 ms·

31.
by searealist 3mo ago
The models themselves support up to 1M. You are just charged more for all context over 400k. The 272k limit is just a client limitation to ensure you can never go over 400k since the maximum output size of the model is 128k.
32.
by searealist 3mo ago
Have you ever said "I'm starving"? Do you think that undermines the experience of people actually starving in war or famine?
33.
by searealist 3mo ago
Please don't act as the hyperbole police. People exaggerate all the time (I'm starving, etc). It's normal, and you are being a jerk to call them out.
34.
by searealist 3mo ago
MTP can give you small batches, but it is still WAY smaller than the batches you can get with prefill, which is limited only by the number of input tokens you have (but has diminishing returns on performance). But: 1) It still makes no sens
35.
by searealist 3mo ago
There are two phases to LLMs: 1) prefill 2) decode For prefill, you are compute bound, and it is trivial to batch multiple input tokens together. When using cpu offload, software like llama.cpp will batch weight uploads with tokens that nee
36.
by searealist 3mo ago
> Kramnik ((ab)using his status as a former world champion) accused several other top level players to the point that one of them committed suicide. There is no evidence of suicide, and he had multiple drugs in his system when he died. &
37.
by searealist 3mo ago
Sindorov, who won the candidates, and will be playing for the world championship, has also had accounts banned on chess.com for (presumably) cheating as a teenager. Do you think it would be ok if a large part of the chess world conspired to
38.
by searealist 3mo ago
It would apply equally to GPU or RAM inference as those are also bandwidth constrained on decode, so people already try to optimize for it.
39.
by searealist 4mo ago
I think they will understand, but it will be a new perspective.
40.
by searealist 4mo ago
My experience of working in the industry is that many of my peers have had great animosity and little sympathy for blue collar workers who lost their livelihood to globalization.
41.
by searealist 4mo ago
I quit over a year ago when one of your moderators banned me for reclaiming an allied unit that was attacking ground on my factory (he was mad at me).
42.
"Green Llama" did not just beat Cascade Platinum Plus(foxchapelresearch.substack.com)
62 points by searealist 11mo ago|30 comments
43.
by searealist 1y ago
I sincerely don’t know which side is lying, and I can certainly imagine situations someone might say that.
44.
by searealist 1y ago
Just to clarify, many third wave shops do serve medium and dark roasts. My point is that third wave coffee shops often call a roast dark when they are actually medium or light. Additionally, I think only light roasts really qualify as third
45.
by searealist 1y ago
This is actually a perfect example. I agree that you can find dark roasts at some third-wave shops, but they are _not_ third-wave coffee. > Our premier dark roast is a nod to the old style of roasting which is still favored throughout th
46.
by searealist 1y ago
Here the first sentence of Third-wave coffee's wikipedia page: > Third-wave coffee is a term primarily in the United States coffee industry emphasizing higher quality, single-origin farms and light roast to bring out distinctive fla
47.
by searealist 1y ago
There are two axes here: - Beans - Roast level The variation from roasting is far greater than the variation from the beans, and all third-wave beans are lightly roasted. This results in a brew that is dominated by acids.
48.
by searealist 1y ago
I've come across many cafes in San Francisco that only have light roast espresso that tastes like lemon juice.
49.
by searealist 1y ago
There would be almost no black people at Harvard if they did not do it.
50.
by searealist 1y ago
You don’t seriously think that is a possibility.
51.
by searealist 1y ago
From what I can tell, it all boils down to one of two things: - Criminal activity - Support of Hamas
52.
by searealist 1y ago
https://en.wikipedia.org/wiki/Students_for_Fair_Admissions_v... Compare the numbers for MIT who is somewhat complying vs the Ivy leagues who are mostly not complying. I agree my original claim is likely not true. I sho
53.
by searealist 1y ago
It's not just Black students over Asians, it is the entire gradient I outlined, and they continue to use race in admissions, they just obfuscate the reasons now.
54.
by searealist 1y ago
The thing is, acceptance at these elite universities is _highly_ correlated with academic performance. It’s just that different racial groups are admitted in different ranges. You won’t find a single Asian at Harvard at or below the median
55.
by searealist 1y ago
Do you think there's a specific (whether public or hidden) criterion being used to deny Asian students based on "leadership abilities"? Or do you think they're simply being held to higher standards or subject to an infor
56.
by searealist 1y ago
> only had traffic violations according to what I read in the Texas Tribune I don't think that is true. Do you have any examples?
57.
by searealist 1y ago
Charges are dismissed all the time when there is guilt. It is not the same thing as innocent. There is a close to 100% chance he admitted guilt.
58.
by searealist 2y ago
A LED TV basically lasts forever. An OLED TV will last maybe 10 years max. Often less in practice.
59.
by searealist 2y ago
At the time, Lidar cost about $80k for the main unit.
60.
by searealist 2y ago
Do you think that is sustainable forever? If not, how long?

More ›