Fripplebubby

9 ms·

61.
by Fripplebubby 2y ago
Awesome summarization by someone who read and actually understood the paper. > One way of increasing the density of the attention layers is to add more context. They show that simply prepending any token as context to a question makes th
62.
by Fripplebubby 2y ago
> the model just reflects those answers I think there is a lot happening in the word "reflects"! Is it so simple? Does this mean that the model takes on the opinion of a specific lit crit essay it has "read"? Does tha
63.
by Fripplebubby 2y ago
I don't know what your operating definition of "grifter" is but for me, a grifter is not a company that delivers a product which gains a large adoption and mindshare (ChatGPT) and essentially sets the world on fire. (not an o
64.
by Fripplebubby 2y ago
I think what they did here was go text prompt -> generate multiple 2d views -> reconstruction network to go multiple 2d images to 3d representation -> mesh extraction from 3d representation. That's a long way of saying, no, I
65.
by Fripplebubby 2y ago
To be more concrete: you might decide not to learn about RNNs, but still find them lurking in the things you did learn about!
66.
by Fripplebubby 2y ago
Ah, that makes sense. So, we consider two hidden layers more as "memory" or "buffers", and actually the rule is implemented in just one layer, at least for a single token.
67.
by Fripplebubby 2y ago
To further problematize this question (which I don't feel like I can actually answer), consider this paper: "Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention" - https://arxiv.org/p
68.
by Fripplebubby 2y ago
Love this post! Gets into the details of what it _really_ means to take some function and turn it into an RNN, and comparing that to the "batteries included" RNNs included in PyTorch, as a learning experience. Question: > To mo
69.
by Fripplebubby 2y ago
Maybe you're being a little tongue-in-cheek about the crypto thing, but, assuming you are at least a little sincere: I think if you drop the benefit of hindsight and change the proposition to "changing careers to one that you are
70.
by Fripplebubby 2y ago
I think they mean, "I'm thinking of creating an instance of Slack that people can join and chat who are in this stage of their journey", not that their idea for a new company is like Slack.
71.
by Fripplebubby 2y ago
The post gets into _so much_ depth around what the company did that worked and didn't work and why it failed as a business. Your comment is about why you personally, one of >250k people who used the service as a candidate, didn&#x27
72.
by Fripplebubby 2y ago
The biggest thing I noticed comparing the two was that OpenAI's method really approached (and appears to have effectively mitigated) the dead latents problem with a clever weight initialization and an "auxiliary loss" which (
73.
by Fripplebubby 2y ago
Please enlighten me - what is the actual explanation that will increase my understanding?
74.
by Fripplebubby 2y ago
I don't accept or condone theft. That's an extreme position. But I do try to understand the way our flawed world works, instead of just wishing that people would see things the same way I do.
75.
by Fripplebubby 2y ago
Not from the article, but from the comments below it. > My phone was stolen while I was going through TSA security at JFK and the TSA guy must have been in on it because he wouldn't let me get it even though we were able to locate i
76.
by Fripplebubby 2y ago
The same can be said for class as well, many people I have met who have grown up wealthy and comfortable and just don't think much about the people who serve their food, do work for them, make the things they buy, and have no idea who
77.
by Fripplebubby 2y ago
Not to be a wet blanket, but yes ignorance should be tolerated and warmly received about things which do not matter much, but sometimes a person's ignorance about certain things can tell you unfortunate truths about the way they view t
78.
by Fripplebubby 2y ago
Medication isn't something they just hand out to anyone who asks. The reason it exists is because there is a large body of scientific research that all points to it helping treat disorders such as ADHD, whether you believe it or not. M
79.
by Fripplebubby 2y ago
For anyone who enjoyed the titles of those links but found that there was just, something in the way of really digging into them, try: NY Times interview with him: https://archive.ph/knd9C NYer Profile: https:/&#x2F
80.
by Fripplebubby 2y ago
Great teacher, great writer. I took one of his undergrad classes, and one day I went in to his office hours to chat - I still remember how relieved he was that I wasn't there to try to debate with him about God, that I wanted to talk a
81.
by Fripplebubby 2y ago
You might want to read the article, which ends with the author flying one.
82.
by Fripplebubby 3y ago
Really interesting! Reading the paper, it sounds like the core of it is broken into two things: 1. Encoding speech sounds into an IPA-like representation, decoding IPA-like into target language 2. Extracting "tone color", removing
83.
by Fripplebubby 3y ago
Oh, you're right. I was thinking about it from the perspective of a passenger, like if you're just a regular non-crew person who travels, then you're probably on Boeing or Airbus, so I picked a metric that I thought would cap
84.
by Fripplebubby 3y ago
It's true that other jets exist, especially regional jets, but remember that these serve overall a fairly small percentage of the seat-miles (aka miles flown * number of seats) overall since they are smaller and fly shorter routes. In
85.
by Fripplebubby 3y ago
What is wrong about my assumptions? I'm not advocating for "move fast and break things" in aviation, I'm saying that actually the issues at Boeing are not as dire as some people believe when considered in their broader c
86.
by Fripplebubby 3y ago
> if you believe Barnett I believe Barnett's claims should be treated seriously and scrutinized by experts in the industry (which is exactly what was happening when he died, by the way - it's not like people were ignoring what
87.
by Fripplebubby 3y ago
> the entire aerospace industry 2 companies? > a miracle we shouldn't expect to be the standard... for decades In the past few decades, the number of scheduled flights has grown tremendously, the number of aircraft has grown, tra
88.
by Fripplebubby 3y ago
> no one is shouting "we must stop all air travel!!!" every time a plane fails and people die. I know this isn't quite what you meant, but that's exactly what we do when a plane fails and people die, as happened in th
89.
by Fripplebubby 3y ago
I've been thinking about this a lot lately. In my opinion, Boeing is a company that is expected to do something about 10x more difficult than other companies: they build and sell massively complex machines that have to work safely and
90.
Disaggregated State Storage and Management Proposal for Apache Flink(cwiki.apache.org)
2 points by Fripplebubby 3y ago|0 comments

More ›