hatthew

5 ms·

31.
by hatthew 2mo ago
My assumption is that the difference is 90% from more memory. I'm making several assumptions because nothing here looks groundbreaking so I don't care to dig deeper, but the model + KV cache definitely cannot fit in memory on the
32.
by hatthew 2mo ago
Is this P2P, or hosted on proprietary servers? How is it funded? I don't like ads and I like free things, but "no ads, free forever" doesn't make me confident in its long term stability.
33.
by hatthew 2mo ago
I think my primary curiosity is: does "rampant AI cheating" mean "most students in most classes" or "a few students in a lot of classes"? The latter is my expectation based on my perception of pre-AI cheating,
34.
by hatthew 2mo ago
Every few weeks I see a headline about a teacher catching 80%+ of their students cheating with AI. I wonder how much newsworthiness selection bias is taking place here? Out of all teachers that do this type of experiment, do 90% of them the
35.
by hatthew 3mo ago
I feel like the basics of information theory are a valuable thing for people to learn, especially as AI that makes up information starts to become more prevalent.
36.
by hatthew 3mo ago
The article has a good point and is correct. But it gets too far down into the weeds. For example, the paragraph about how priest conversions don't count as empire-building seems like the sort of argument one makes when desperately clu
37.
by hatthew 3mo ago
I read that part and I still don't like the article. I have several hundred hours in AoE2. Maybe I am unique, but it has never even occurred to me to call the collection of people and buildings I control an "empire". I think
38.
by hatthew 3mo ago
For typical social media sites, engagement will pretty much always be proportional to both revenue and cost per user. Either revenue > cost, and the site is incentivized to increase engagement, or revenue < cost and the site dies. The
39.
by hatthew 3mo ago
Presumably significantly less. But GP's point is that reducing advertising revenue doesn't remove the incentive to maximize engagement.
40.
by hatthew 3mo ago
If it is to be believed—which I wouldn't count on—it sounds like the intention of the prompt was to keep the model focused, but the model's interpretation of it was to keep you focused.
41.
by hatthew 3mo ago
Some guesses: - A lot more direction-dependent. - More maintenance related to keeping the right direction, maintaining more moving parts, etc. - Less convenient form factor, more susceptible to wind, more unsightly. - Less space-efficient,
42.
by hatthew 3mo ago
Simply by the fact that you say computer engineering, you already went deeper than 99% of "computer people" in 2010
43.
by hatthew 3mo ago
With a car, when I turn the steering wheel a quarter turn, the car immediately starts to turn at a known rate (I can't quantify it, but my muscle memory knows it). With an LLM, if I ask it to "turn the car", my "steering
44.
by hatthew 3mo ago
This matches my experience coding, and the expectations I (and many other) have been voicing for years about why AI is still a ways away from solving coding. The hard part of programming isn't pressing the keys to put code into a file,
45.
by hatthew 4mo ago
I'm also curious, specifically about the cost of training vs inference, and comparing that to other industries that can have high R&D costs. My instinct says that open weights aren't feasible because of the obvious issue where
46.
by hatthew 4mo ago
To me, hippopotomonstrosesquippedaliophobia feels less like vocabulary and more like trivia
47.
by hatthew 4mo ago
It's a bad aphorism if you take it literally and don't think about any nuance, but it's the correct priority . In many cases each of the three steps can take longer than the last, and each step is useless if the previous ste
48.
by hatthew 4mo ago
I have a similar anxiety about emailing or messaging people directly. If I'm just posting a comment on HN or reddit, there's not much commitment and if someone responds but I don't feel like continuing the thread, it's f
49.
by hatthew 4mo ago
This feels like less of a gamma issue and more of a color space and monitor calibration issue. Possibly affected by the fact that oklab didn't exist when this article was written and the general awareness of color spaces was lower.
50.
by hatthew 4mo ago
As someone with no plans to live or vacation in the caribbean, I'm curious. Is there a specific notable reason, or is it just a combination of littler things (cost, convenience, politics, weather, etc.)?
51.
by hatthew 4mo ago
Part of the premise of the article is blatantly wrong. Distillation prevention was always visible. The only invisible safeguard was against frontier model development like development of training pipelines. This doesn't change the gene
52.
by hatthew 4mo ago
Our logic at the time was that the relatively fixed cost of figuring out the hardware and developing device-specific software was less than the variable cost-per-board delta of like $20.
53.
by hatthew 4mo ago
Huh. I had a work project a decade ago where we were evaluating SBCs as drivers for kiosks. At that time, the prevailing wisdom was that the Pi was specifically not for industry, as its main advantage was the strong community to provide s
54.
by hatthew 4mo ago
genius
55.
by hatthew 4mo ago
This misses the point of the discussion. Yes, we can understand what it is like to be a human with echolocation. However, we can't understand what it is like to be a bat .
56.
by hatthew 4mo ago
Anyone not familiar with "JPL" will not be helped by spelling out "Jet Propulsion Laboratory", since it's a misnomer anyways.
57.
by hatthew 4mo ago
TFA addresses this > Now, we all know that it can take a while to find a long sequence of digits in π, so for practical reasons, we should break the files up into smaller chunks that can be more readily found. > In this implementation
58.
by hatthew 4mo ago
I work on "AI" stuff. Not LLMs, but large neural nets that include transformers and are as big as the smaller LLMs of today. Half the prompts I give fit their category of examples like "building pretraining pipelines, distrib
59.
by hatthew 4mo ago
In addition to what mbauman said, hair follicles and the hair itself are not single-cell. I can't immediately find the composition and average cell size, but even a long and thick strand of hair is less than 2 orders of magnitude large
60.
by hatthew 4mo ago
Some back of the envelope math says this is true. A conservative estimate for the size of an alpha motor neuron axon is 10μm diameter and 1m long, which already puts it over an order of magnitude larger than the 4,000,000µm³ oocyte quoted i

More ›