dwaltrip

40 ms·

691.
by dwaltrip 3y ago
This is an uncharitable reply. Don’t assume the worst about your conversational partner. That being said, didn’t the first gpt-like models do character level prediction? Essentially no tokenization? Also, the idea of “what if we removed &#x
692.
by dwaltrip 3y ago
What are the technical hurdles to removing tokenization? What are the leading alternative approaches? Character-by-character prediction? Thinking about human brains, it seems we operate on an ever-evolving set of symbols, at various levels
693.
by dwaltrip 3y ago
Ah, yeah with the company names, I think it is simply an abbreviation for "brothers". A bit of miscommunication.
694.
by dwaltrip 3y ago
The way words are used gives them their meaning. If "bro" is used differently than "brother" in certain contexts, then they have different meanings in those contexts. In my experience, it does have different meanings. On
695.
by dwaltrip 3y ago
My intuition is that the new crop of AI tools is still higher leverage for individuals than for large organizations. And given how software development historically has scaled sub-linearly with org size, I expect we will see interesting de
696.
by dwaltrip 3y ago
The models should be trained to use different “ways of thinking” when they are more useful and effective. Or to even discover their own better ways of thinking.
697.
by dwaltrip 3y ago
It’s not just random text, they are predicting writings and documents produced by humans. They are “language” models. Language is used to say things about the world. This means that predicting language extremely well is best done through ac
698.
by dwaltrip 3y ago
PDFs are pretty shite on mobile. Interesting that there isn’t a common solution for this. I guess it’s rather niche?
699.
by dwaltrip 3y ago
Why can’t you get a different, less stressful job? Life is too short.
700.
by dwaltrip 3y ago
This is an incredible link. I can’t believe I haven’t seen it before. I had a rough sense that this was the case, but those quotes (and sources) make it undeniably clear. [Insert standard caveat about his wide array of harmful and toxic beh
701.
by dwaltrip 3y ago
It isn’t. But defaults are quite powerful.
702.
by dwaltrip 3y ago
iMessage features not present in MMS: * Reactions * Threaded replies (1 level deep) * You can name group chats and give them a custom image / icon (makes it easier find a group in the list). The name and image is applied for everyone i
703.
by dwaltrip 3y ago
For a while now I’ve been going on walks without my phone. It’s really nice. And freeing in a certain sense.
704.
by dwaltrip 3y ago
Are you arguing the humans are not merely looking at the shadows on the cave wall but LLMs are? Or that the shadows that the LLMs sees are fundamentally different / worse than ours? > All that is can do is associate and surface patt
705.
by dwaltrip 3y ago
> probabilistic word salad generator > Exactly no progress has been made in understanding or creating real intelligence in any meaningful sense Strong words… The thing has understanding. It may be alien and imperfect, with strange fai
706.
by dwaltrip 3y ago
I believe there is also the option of structuring it as a “public benefit corporation”.
707.
by dwaltrip 3y ago
I think this is pretty much all of programming. Or life in general. There’s plenty good and plenty bad. It’s no use fixating on things you can’t change. Focus on what you can do.
708.
by dwaltrip 3y ago
This is a good point. However, even if we account for this and subtract all products that are currently digitized poorly, I think we still get a very large positive number. The number of useful digital products that don’t yet exist is enorm
709.
by dwaltrip 3y ago
https://en.m.wikipedia.org/wiki/Curse_of_dimensionality Sounds like you are both right?
710.
by dwaltrip 4y ago
Hmm… How are the other aspects of your life? Do you like your job? Are you burnt out or depressed?
711.
by dwaltrip 4y ago
It’s a medium-sized if. So many people said they couldn’t land the Falcon-9 booster. Ignoring the mars stuff, the vision isn’t that crazy, given their track record. Biggest questions in my mind are: how rapidly reusable will it actually be
712.
by dwaltrip 4y ago
For those who don't know, Starship is the first fully-reusable orbital rocket. If they manage to get it working as designed, it would radically change the economics of going to space. You can imagine the savings from not having to rebu
713.
by dwaltrip 4y ago
It doesn’t take much imagination to see how it would radically alter human existence and civilization in ways we can hardly fathom. That said, death is rather terrible so I am in favor of curing aging to the extent that we can, while workin
714.
by dwaltrip 4y ago
> In general, I’d say that GPT-4 was strongest on true/false questions and (ironically!) conceptual questions—the ones where many students struggled the most. It was (again ironically!) weakest on calculation questions, where it wou
715.
by dwaltrip 4y ago
Gpt-4 is a far better poet than gpt-3. It isn’t world-class and may be missing some ineffable poetic soul, but its attempts are definitely notable and interesting. They seem mostly better than what I could write with significant effort. Oh
716.
by dwaltrip 4y ago
A huge portion of the improvements in each successive version of gpt came from increasing the model size and the amount of training data. The research trends indicate that there still are additional improvements to be found by continuing to
717.
by dwaltrip 4y ago
Gpt-4 hallucinates meaningfully less than gpt-3. There is more evidence in favor of “more improvements to come” than “ai winter approaches”. A lot smart people seem to be saying that the existing approaches have room to improve simply by tr
718.
by dwaltrip 4y ago
Humanity invented those things. Individual humans were taught those things, either directly or indirectly by observing / listening to others. We do learn through our experience, of course. But most of what we learn is from others in on
719.
by dwaltrip 4y ago
And the NASA press release: https://www.nasa.gov/feature/goddard/2023/hubble-sees-possib... Not sure what the deal is with this hubblesite.org… Edit: Ah ok, interesting… It’s entirely legit. The “about us” pa
720.
by dwaltrip 4y ago
The cost of those items is incredible trivial compared to the salary they paid you. There is a sort of quirk here that causes people to focus on things like this, even if they are overwhelmingly insubstantial. Wasting physical objects feel

More ›