typon

18 ms·

181.
by typon 3y ago
White woman vs. Black guy treatment. We shouldn't gloss over that.
182.
by typon 3y ago
I kind of wish Casey would stop making these videos. I'm being completely serious when I say that this kind of knowledge and mindset gives you pretty much a superpower in the industry. Everywhere I go people think I am amazing, even th
183.
by typon 3y ago
Sundar Pichai becomes CEO on October 24th, 2015, GOOG stock price is ~$36.87 On Apr 25, 2023 GOOG stock price is ~$103.85. I don't understand this narrative against Pichai. This is objectively a massive success in any reasonable metric
184.
by typon 3y ago
That's actually the hidden secret. Millions of people are using it to solve their problems quietly - something Google and other companies whose lunch they're eating should be worried about rather than being worried about grand ide
185.
by typon 3y ago
No, that's the wrong interpretation. The truth is that there is no such thing as "electron flow". It's not a quantum mechanical concept, just a classical approximation.
186.
by typon 3y ago
Shortening sentences using longer sentences
187.
by typon 3y ago
that goes against the narrative
188.
by typon 3y ago
So if someone sells me a good are they democratizing it to me?
189.
by typon 3y ago
There's no a priori reason to assume that models would see a step function improvement in abilities as their size increases. Perhaps the null hypothesis would be that we'd observe a linear increase in capability. Empirical evidenc
190.
by typon 4y ago
Is Duolingo basically spaced repetition for language learning?
191.
by typon 4y ago
I don't understand why that's so difficult for people? Just don't connect it to the internet. It's going to magically show you ads or track you without internet.
192.
by typon 4y ago
I use it for thing's that don't really matter if they're exactly correct. For example, coming up with a travel itinerary for a country I have never visited. Rewriting a work email with better English. Summarizing a news artic
193.
by typon 4y ago
So is doing drugs. Not the free part though :p
194.
by typon 4y ago
Yes, GPT3.5 gives pretty bad results. GPT-4 gives way better results
195.
by typon 4y ago
I actually clicked through to the links GPT-4 provided (Guardian or SCMP articles)
196.
by typon 4y ago
Google search has absolutely deteriorated to the point of being useless for me. The only valuable thing left from are walled gardens like Google Maps that contain curated information. The open web, or at least Google's understanding of
197.
by typon 4y ago
Each with a different temperature too - kind of like a multi-armed bandit but exploring different parts of the LLM manifold.
198.
by typon 4y ago
Build quality, Model 3 is not "much quicker", Ioniq has a higher range, customer service, interior design, better colors
199.
by typon 4y ago
Just test drove an Ioniq 6 the other day. Insanely fast, beautiful and the software is pretty good too. Model 3 doesn't even compete.
200.
by typon 4y ago
The last point is all that matters. It will be painful and take a while for Americans to come to grips with it, or we will all die in an apocalypse when they can't accept it.
201.
by typon 4y ago
Creating something is much harder than verifying it. A simple setup for improving coding skills is the following: 1. GPT is given a coding task to implement as a high level prompt. 2. It generates unit tests to verify that the implementatio
202.
by typon 4y ago
Very good analysis. I disagree with a fundamental point though: If you don't consider compute cost and just want the best possible AGI, then there's nothing stopping you from supercharging the mega-models with the same capabilitie
203.
by typon 4y ago
Yes - for example adding memory to the attention mechanism (similar to RETRO or Memorizing Transformers paper)
204.
by typon 4y ago
It's not true we know nothing. We know a little bit by using the two models from their API. Given the time per inference and the limit on messages per day for GPT4, I'm willing to bet it's doing around 10x more compute than G
205.
by typon 4y ago
Key point is vaguely good. Scale is still important and that manifests in the difference between gpt3.5 and gpt4 based chatgpts. It's qualitatively and quantitatively so much better in pretty much every benchmark. There is no way aroun
206.
by typon 4y ago
That's how Alpaca is made
207.
by typon 4y ago
All within three months. My head is spinning.
208.
by typon 4y ago
I found that "continue exactly where you left off" will continue in a way that you expect it to more often.
209.
by typon 4y ago
Exact same experience I had. I would also add that the CSS styling doesn't really work. And it's frustrating because I would prefer if it didn't work all time, but it seems to only not work some of the time and I can't f
210.
by typon 4y ago
Unfortunately I felt the same way. I'm probably their prototypical target audience (neovim user, I stay in the terminal 99% of the time) and I couldnt justify switching over to nushell full time. I wish they didn't change the synt

More ›