blagie

69 ms·

751.
by blagie 4y ago
It's only a toy if your intention is to use it like ChatGPT. There were plenty of good uses for such models prior to ChatGPT, and the recent progress has impacted all the other uses too.
752.
by blagie 4y ago
<-- For all of these projects, this is the major question. I just wish it was standard form to include: "This project requires __GB of RAM, and, if running on GPU, __GB of VRAM for the _B parameter model. It will generate output at
753.
by blagie 4y ago
Equity in startups which had deposits there. If you need $100k next month to meet payroll, and you had it deposited in SVB, the Fed will cut you a cheque for $100k, and in return, receive $100k in equity at the more advantagous (to the Fed)
754.
by blagie 4y ago
I'm 100% in support of a bailout... ...with the federal government taking equity in return, at the last valuation, diluting existing owners. That would let the businesses keep running, without the "privatize gain / socialize
755.
by blagie 4y ago
Exactly. It's not just not-JSON, but it's obnoxious and hard to manipulate programmatically, on either end (client or server). That translates to a lack of tooling around it, an inability to write sane tooling, and difficulty inte
756.
by blagie 4y ago
I don't like GraphQL due to the complexity. It's not JSON or YAML, and requires a lot of custom stuff on both ends. I'd like something like GraphQL, but built on standard data formats.
757.
by blagie 4y ago
I think you're being overly harsh. That describes literally every culture in the world: There is a ton of mutually-held assumptions, and if you don't buy into them, you look weird. I like diving into different cultures since they
758.
by blagie 4y ago
This post seemed weird. There's a pretty broad range of possible outcomes, from apocalypse to lost jobs to utopia to little changing at all. This is arguing presuming a high level of certainty in one of those outcomes.
759.
by blagie 4y ago
It's a little bit weird. In semiconductors, we ran into the same problem. "large scale integration" happened at 500 transistors, and "very large scale integration" at 20,000. For a while, "ultra large scale int
760.
by blagie 4y ago
> And we’re about to plug them straight into critical business flows? Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. LLMs don't need to be perfect. The bar they
761.
by blagie 4y ago
Something that allows me to cleanly handle multiple keyboards and mice on Ubuntu, map them to interesting Unicode characters, as well as to macros. I'm not sure what your link does for me. It points to some proprietary Mac app, as well
762.
by blagie 4y ago
I'd totally do this as well, if there were good software support in Ubuntu. Each time I think about another thing to maintain, I give up. I would like dedicated buttons for my different desktops (with proper labels), and there's a
763.
by blagie 4y ago
In 2020, there were quite a few possibilities, ranging from "it's a flu" to "the new normal." I think share prices had all of those baked in. "New normal" would have meant the end of retail. Now that we kn
764.
by blagie 4y ago
I think it's complex. The obvious reasons are the covid-19 bump is gone, and all tech stocks are down. The less obvious reason is that Amazon retail growth doesn't seem to have as much of a long-term due to: 1) Market saturation 2
765.
by blagie 4y ago
Thanks. Ti-po, I guess :)
766.
by blagie 4y ago
A lot of people are looking at this wrong. A $350 3060Ti has 12GB RAM. If there's a way to run models locally, it opens up the door to: 1) Privacy-sensitive applications 2) Tinkering 3) Ignoring filters 4) Prototyping 5) Eventually, a
767.
by blagie 4y ago
You have a deep misunderstanding of how large-scale neural networks work. I'm not sure how to draft a short response to address it, since it'd be essay-length with pictures. There's a ton of internal state. That corresponds t
768.
by blagie 4y ago
We have no idea what it's inner state represents in any real sense. A statement like "it's 'inner thoughts' are exactly the same as it's output, since it doesn't have a separate inner voice like we do&quot
769.
by blagie 4y ago
Yes. Keep in mind that we have no idea which model we're dealing with, since all of these systems evolve. My experience in summer 2022 may be different from your experience in 2023.
770.
by blagie 4y ago
I don't think these are faked. Earlier versions of GPT-3 had many dialogues like these. GPT-3 felt like it had a soul, of a type that was gone in ChatGPT. Different versions of ChatGPT had a sliver of the same thing. Some versions of C
771.
by blagie 4y ago
About two decades ago, there was a nice article about a hierarchy of memory cards. The chips are binned: - Reliable chips were placed in name-brand products - Defective chips have the defective parts disabled, and were placed in products on
772.
by blagie 4y ago
Here's my problem: I'm glad to pay a premium for Sandisk if it guarantees reliable, honest, and accurate devices. I can buy generic flash drives for a fraction of the cost. If Sandisk is starting to cheat, why would I pay the prem
773.
by blagie 4y ago
I think there is also a question of organizational size. A 4-person team in one room can be a hyper-efficient cohesive unit, a lot like a family or a group of friends. A 100-person organization requires very different processes, with planne
774.
by blagie 4y ago
Except for the wonky webcam (which I can live with), and the lack of GPU (which I'm less sure about; I do a lot of ML workloads), this laptop is exactly the laptop I'd buy, if I knew it actually existed. Problem is, I'm not c
775.
by blagie 4y ago
A performing team helps! On the whole, though, it's easiest to do that with low expectation setting. If I can convince management that what my team is doing is Very Hard and Very Important, my team will be perceived as high-performing.
776.
by blagie 4y ago
A manager's primary responsibilities are: - to find a way to keep their job through layoffs - to find a way to move up to director - to have fun at work - to maintain work-life balance ... and so on.
777.
by blagie 4y ago
Layoffs are coming. You're a manager. You have ten employees: - Grumpy. Grumpy doesn't like you, and you don't like Grumpy. He doesn't keep you updated, and seems to sit in an office with a closed door. He complains a bi
778.
by blagie 4y ago
Because low-performers are nearly impossible to identify, at least from a CEO level. There are two things one can be doing in a job: 1) Their job 2) Signalling to everyone around how much they're doing, and how hard it is Universally,
779.
by blagie 4y ago
It's both really shallow and really deep. On one hand, you can explain it to a 5-year-old: Go in the direction which improves things. On the other hand, we have more than a half-century of research on sophisticated mathematical methods
780.
by blagie 4y ago
You're wrong: * Pick any European keymap under Ubuntu, Windows, or Mac with your US keyboard * Hold right-alt and press a key You'll get something like ń or ą. Bonus: Under Ubuntu, you might also have other keys remapped to let yo

More ›