wrsh07

26 ms·

421.
by wrsh07 3y ago
Ok so my understanding: you can have the network generate a token that can be used as input to future token generation along with each output token it generates These are called reasoning tokens Initial results with gpt2 are promising You c
422.
by wrsh07 3y ago
The regexprouter compiles all of the routes into a single matcher, so you're not doing a linear search of all of your routes (lots of routers are essentially doing an if else on all of the routes). They also have a similar trie router,
423.
by wrsh07 3y ago
The BBC...?
424.
by wrsh07 3y ago
I love the lord of the rings / phone metaphor
425.
by wrsh07 3y ago
Honestly, the thesis of this should be "be your own technical cofounder" or "let ChatGPT be your technical cofounder" It has never been easier to do things you've never done before Programming tutorials are ubiquito
426.
by wrsh07 3y ago
I'm curious why you think this My understanding is that the APIs are profitable, and the best alternative (spin up mixtral on cloud provider) isn't that expensive. So there's some downward pressure there. I expect ChatGPT is
427.
by wrsh07 3y ago
While we're discussing flaying and I'm discussing catholicism, you all should look at the St Bartholomew statue: https://en.m.wikipedia.org/wiki/Marco_d%27Agrate
428.
by wrsh07 3y ago
Certainly one of the stranger parts (to me) of visiting old Catholic churches is seeing the reliquaries [1]. Since I'm an atheist, I don't really have particularly strong feelings about what happens after I die (ideally: reasonabl
429.
by wrsh07 3y ago
I think boom is aware of this and is planning to make their planes efficient at 90% speed of sound
430.
by wrsh07 3y ago
Because nobody did it! Airlines are absolutely brutal businesses. Airplane manufacturing is at least as brutal. Trivia question: how long did it take the Boeing _ (pick any make) to become profitable? It's an enormous risk to build a n
431.
by wrsh07 3y ago
Why assume "cramped overture"? What if overture feels like first class but is ~faster? I suspect fast planes are going to have an enormous amount of demand - people value their time. What's the most important part of travel?
432.
by wrsh07 3y ago
My understanding is the the Concorde wasn't profitable to fly (too large!) You can fly subsonic over land and go supersonic over oceans. That would make a trip to Japan much faster! And won't impact humans living underneath the fl
433.
by wrsh07 3y ago
I think there's also an element of moving goalposts. Maybe we understand certain structures of a fully connected nn, but then we need to understand what's happening within a transformer. They're going to continue to get more
434.
by wrsh07 3y ago
What's the benefit of Wikipedia? Or MIT license on your open source library? Allowing people to remix your stuff can lead to awesome outcomes, just not personally financially beneficial
435.
by wrsh07 3y ago
It's an incredible facility indoors and out, with some really great works (especially given the age of the collection - it's relatively new compared to some larger institutes) When I was there they also had an awesome special exhi
436.
by wrsh07 3y ago
I am curious what additional attacks knowing the last layer of an LLM enables. Eg you go from a black box attack to some sort of white box [1] Does it help with adversarial prompt injection? What % of the network do you need to know to iden
437.
by wrsh07 3y ago
Yup - right at the top of the second page they note their disclosure practices. It's still a pretty wild attack. > Responsible disclosure. We shared our attack with all services we are aware of that are vulnerable to this attack. We
438.
by wrsh07 3y ago
To me, if it detects bugs (and fixing those makes the others reachable), that seems like a pretty acceptable iterative step It's less academically pure, but as an engineer who wants to fix bugs it seems ok
439.
by wrsh07 3y ago
I think saying "of the decade" but meaning "of the [past] decade" where decade means "a period of ten years" is pretty reasonable Quibbling with that sort of misses the point, no?
440.
by wrsh07 3y ago
He was building small, efficient versions of gpt 3 in a video series You can check his GitHub: https://github.com/karpathy
441.
by wrsh07 3y ago
At Google (long time off and on home of Hyrum), they migrated to swisstable from other hash maps. Unordered map iterates through the elements in insertion order. They explicitly couldn't support that without adding overhead to their ne
442.
by wrsh07 3y ago
A reference to the good doc: https://www.semianalysis.com/p/google-we-have-no-moat-and-ne... While I'm linking semianalysis, though, it's probably worth talking about how everyone except Google is GPU poor:
443.
by wrsh07 3y ago
I would love to have a compute backpack that can charge my phone or serve as the computer for my VR headset I would still want it to be relatively lightweight, but you could go much heavier than on the head and have it still be comfortable
444.
by wrsh07 3y ago
At the very least there's the low tech solution of an opaque cover you put over it AR and VR have always felt like duals to me - with AR, you just put something behind it and you have VR. With VR you do passthrough video
445.
by wrsh07 3y ago
I would love to read your (future) piece about legibility of typefaces! You're correctly describing facts (eg the font apple uses doesn't let me tell the difference between llama and Ilama), but that's mostly not needed when
446.
by wrsh07 3y ago
The worst part of being an early adopter (very first world problems) is that nothing exists yet. When 4k HDR was first being supported, a couple of Netflix shows were there and... not much else (some YouTube videos of dubious quality) Visio
447.
by wrsh07 3y ago
There's the classic "when someone tells you there's a problem here, they're usually right. When they propose a fix, it's usually wrong" To me, this post falls squarely in that bucket. It correctly identifies is
448.
by wrsh07 3y ago
Yes! My counterargument will reference the rust language ergonomics initiative post (which imo is seminal) In particular, they say > One final point. "Implicitness" is often relative to where the language is today, something th
449.
by wrsh07 3y ago
For websites (eg UI testing) you normally annotate things to be clicked, so I don't find this super compelling Parsing text (eg html) is a bit easier than parsing images, although maybe the difference is going to zero
450.
by wrsh07 3y ago
There are some great options hidden there! There's a zoom (I use 3 finger double tap to trigger) and you can have it read the text on a page for you. It's a robotic voice, but it's pretty great if you want someone to narrate

More ›