jph00

6 ms·

31.
by jph00 8mo ago
This is not due to slowness of the file system. Native ntfs tools are much faster than Unix ones in some situations. The issue is that running Unix software on windows will naturally have a performance impact. You see the same thing in reve
32.
by jph00 9mo ago
Obviously what matters is how much of the world’s products they produce - especially products that require high energy input. I can’t imagine why you think per capita is the appropriate statistic to compare. This has already been pointed ou
33.
by jph00 10mo ago
I got one of these stupid emails too. I’m guessing it spammed a lot of people. I’m not mad at AI, but at the people at this organisation who irresponsibly chose to connect a model to the internet and allow it to do dumb shit like this.
34.
by jph00 10mo ago
It reads exactly like all his writing over many years afaict. Which is to say - it reads well. Just because someone is clear, thoughtful, and thorough, does not make them an AI. AI writing is actually quite different to this.
35.
by jph00 10mo ago
Your request to read charitably is not supported by your followup of cartoonish straw man questions. You are using rhetorical trickery to make a point rather than engaging in honest dialog.
36.
by jph00 10mo ago
You misunderstand how neurodivergence is be handled in education. It isn't a single diagnosis, and does not have a single accommodation. We use a catch-all word because it makes it easier to talk about as a collection of issues, but th
37.
by jph00 10mo ago
You incorrectly drew an implication. The authors words only actually imply that some accommodations are still needed, not that they are the same accommodations. This conclusion is obvious given that the underlying condition is not curable.
38.
by jph00 10mo ago
A third is about as common as astigmatism in >50 year olds (like me, for instance!) I wear glasses to accommodate this disability, and as a result have nearly no practical problems due to it. I don't think a problem having a high fr
39.
by jph00 10mo ago
I don't know about Stanford, but in earlier schooling accomodations can include things like being allowed to sit on a bouncy chair, or use a fidget toy, or type instead of hand-write (physical asynchronous development is a common issue
40.
by jph00 10mo ago
Amongst groups for extremely gifted kids I’ve seen, well over half are neurodivergent. It’s a well understood issue in gifted kids psychology. When these kids are accommodated appropriately they ace their classes, and when not, they fail ou
41.
by jph00 10mo ago
If Sam said that, he is wrong. (Remember, he is not an AI researcher.) Anthropic have been using this kind of approach from the start, and it's fundamental to how they train their models. They have published a paper on it here: https:
42.
by jph00 10mo ago
On Mac you type opt-shift-hyphen — like this — and on Win/Linux you use a compose key. A lot of people who care about typography/grammar have spent a moment to learn to do this. Once learned, you can use it for the rest of your li
43.
by jph00 10mo ago
IMO the em-dash version is way easier to read in this example, FWIW.
44.
by jph00 10mo ago
The article didn't read at all like AI-generated text.
45.
by jph00 11mo ago
And not even in their native tongue :(
46.
by jph00 11mo ago
There’s already a language that provides all the features of awk plus modern language conveniences, and is available on every system you can think of. It’s Perl. It even comes with an auto translator for converting awk to Perl: https:&#x2F
47.
by jph00 11mo ago
The author does not say a script works as well as a proof.
48.
by jph00 1y ago
We knew in 2017 that PyTorch was the future, so moved all our research and teaching to it: https://www.fast.ai/posts/2017-09-08-introducing-pytorch-for... .
49.
by jph00 1y ago
Actually there are VAEs which use a codebook approach to creating discrete tokens instead of float vectors. There has been some success in that direction in diffusion models for instance.
50.
Let's Build the GPT Tokenizer: A Complete Guide to Tokenization in LLMs(fast.ai)
20 points by jph00 1y ago|0 comments
51.
by jph00 1y ago
(2) is not quite right. I created ULMFiT specifically because I thought a language model pretrained on a large general corpus then fine-tuned was the right way to go for creating generally capable NLP models. It wasn't an accident. The
52.
by jph00 1y ago
This is quite a good overview, and parts reflect well how things played out in language model research. It's certainly true that language models and deep learning were not considered particularly promising in NLP, which frustrated me g
53.
by jph00 1y ago
Everything is recorded so it doesn't matter at all if you catch up later. Some people in the preview course didn't start until we finished! Obviously you'll get better interaction with the community if you're following a
54.
by jph00 1y ago
Yes I think you've done a good job of capturing the key ideas. Thank you for taking the time to look into it! I think you might be somewhat under-estimating the amount of novel ideas in, and the significance of, the solveit platform. B
55.
by jph00 1y ago
The 400 includes platform access from signup until a few weeks after course finishes. No quota - use whatever you need. You can't purchase access to the platform directly. It's not aimed at junior devs - e.g here's a post fro
56.
by jph00 1y ago
At the end of the last course we put out a survey and asked for feedback. There were multiple questions in the feedback form. That's why there are multiple quotes from each person. If you google any of those names you'll see they
57.
by jph00 1y ago
Oops that should say "which fast.ai is now part of". s/not/now/
58.
by jph00 1y ago
I apologise folks that we did a bad job of explaining exactly what we're launching! My bad. :( I've added this to the top of the article now -- I hope this does a better job of explaining things: ---- *tldr from Jeremy:* You can n
59.
by jph00 1y ago
That's fair! I guess since it's a new thing that doesn't quite neatly fit in a category, we were perhaps too shy about trying to define it. Also, we really want to focus on the methodology, rather than the platform. But yes,
60.
by jph00 1y ago
Latent Space just released an interview about Solveit: https://www.youtube.com/watch?v=01ybLOH1fnU

More ›