cavisne

21 ms·

1. 271.▲
   by cavisne 4y ago

   Yes, but to move the needle you need to use another single vendor Mellanox (which nvidia owns). So the (slight) differentiations are. AWS - gpudirect and high bandwidth (but also high latency) GCP - 16 gpus on one machine Azure/OCI - m
2. 272.▲
   by cavisne 4y ago

   GPU's in cloud is just a bad business unfortunately. There is only one vendor (for anything scientific/ML anyway) and you have to buy specific (overpriced) models from them to be compliant with the license. So zero negotiating pow
3. 273.▲
   by cavisne 4y ago

   Maybe there was something strategic about Dall-E, used for some sort of dataset collection/tuning for GPT4. Like how Whisper unlocks a lot more text data for GPT4.
4. 274.▲
   by cavisne 4y ago

   The founder gave an interesting interview about this. In short when they did user testing with a Web UI, people would write a basic prompt "dog", "cat" and then get stuck. Discord makes it social by default, you can see
5. 275.▲
   by cavisne 4y ago

   I meant more broadly the train crashes in the US, although the light rail specifically has also had problems https://www.seattletimes.com/seattle-news/transportation/sou...
6. 276.▲
   by cavisne 4y ago

   This sort of stuff combined with the train situation really does feel like the start of an Ayn Rand novel. I will say this is a remarkably small overspend for this sort of project though "Originally earmarked to cost no more than $968
7. 277.▲
   by cavisne 4y ago

   Hilarious, that last graph really shouldve been in this puff piece article.
8. 278.▲
   by cavisne 4y ago

   I don't see a lot of traditional "HPC engineers" in the ml infrastructure space though. I do wonder if in hindsight using a Slurm cluster for scheduling, Lustre for data, MPI for any connectivity thats not covered by NCCL, wo
9. 279.▲
   by cavisne 4y ago

   LLM training (at least the ones we have research details on) sync weights every step so they have very high networking and latency needs. That’s why every cloud vendor competes on interconnect speeds for GPU machines. So they are basically
10. 280.▲
    by cavisne 4y ago

    It’s going to be so much easier to push these models out to the edge if they are open source (see ggml, diffusion bee etc). This won’t be possible without accelerator compute for training. Open source developers can’t afford this compute. A
11. 281.▲
    by cavisne 4y ago

    There is a minimum cluster size to get good utilization of the GPU’s. $1 an hour per chip might get you one A100 but it won’t get you hundreds clustered together.
12. 282.▲
    by cavisne 4y ago

    Is it weird that this wasn’t in a TPM somewhere? I don’t know how host keys work, are they rotated based on some root cert regularly or is it just the same keypair since the creation of GitHub?
13. 283.▲
    by cavisne 4y ago

    For whisper whisper.cpp is probably a better bet, it also doesn’t use the NPU but it performs much better than the pytorch implementation.
14. 284.▲
    by cavisne 4y ago

    Nvidia's business model encourages this for starters. They charge a huge markup for their datacenter GPU's through some clever licensing restrictions. So it is cheaper per FLOP to run inference on a personal device. Centralization
15. 285.▲
    by cavisne 4y ago

    No, they banked there because SVB would throw money at VC's and founders (ski trips, free meals, lines of credit) who in turn would recommend/force their companies to use the bank. For all the talk of being "friendly" an
16. 286.▲
    by cavisne 4y ago

    so silvergate assets exceeded/matched its deposits? I know it was a pretty niche bank just curious as I thought it was in a way worse position.
17. 287.▲
    by cavisne 4y ago

    Doesnt this just push the can down the road? Interest rates will likely be higher not lower in 1 year so their bond portfolio will be even more underwater.
18. 288.▲
    by cavisne 4y ago

    Curious there was nothing about silvergate?
19. 289.▲
    by cavisne 4y ago

    SVB saw more than 25 percent of their deposits withdrawn. No bank could handle that. Ultimately the money has to go somewhere (it won’t fit under everyone’s mattress) so a big bank would be unlikely to fail.
20. 290.▲
    by cavisne 4y ago

    Companies have to guess what is PII and what is not, the EU have no idea (other than they know which companies they want to punish)
21. 291.▲
    by cavisne 4y ago

    And the 2 “closed” in seattle have been boarded up for some time, they are in an area that became even higher crime during Covid and never really recovered.
22. 292.▲
    by cavisne 4y ago

    There is a large administrative load for all healthcare which seems to serve no one except the hospitals (to avoid paying any local taxes their non-profit status does not get them out of), and the insurers (who justify their margins by nego
23. 293.▲
    by cavisne 4y ago

    Does openai actually specify the size of the model? InstructGPT 2B outperformed gpt 3 175B, and chatgpt has a huge corpus of distilled prompt -> response data now. I’m assuming most of these requests are being served from a much smaller
24. 294.▲
    by cavisne 4y ago

    This has been downvoted but I have to say, living atlas seems like an awesome resource
25. 295.▲
    by cavisne 4y ago

    Google Books does seem to still be digitizing books (albeit with the various copyright lawsuits they arent displaying many results) [1] So they would be in a unique situation to build this, as they have 40 million books many of which no one
26. 296.▲
    by cavisne 4y ago

    It went viral in Montana and was not shot down until it left the country in North Carolina. If this was a planned media push it would have been shot down before it entered the united states.
27. 297.▲
    by cavisne 4y ago

    I feel like this is getting really close. GPT is create at writing sql queries from text and turning a blob of semi structured data into an sql schema. We just need to somehow tie it together so anyone can explain their use case, and show a
28. 298.▲
    by cavisne 4y ago

    I do a daily walk for ~30 minutes. For me the key to enjoying exercise was losing weight. When you are overfat you tend to have quite strong legs from carrying the excess weight around. Even with minimal strength training losing fat will le
29. 299.▲
    by cavisne 4y ago

    Linkedin and Salesforce PM's tend to be the stereotypical answer (products that haven't changed for years).
30. 300.▲
    by cavisne 4y ago

    Blaming hedge funds is a misdirection. Google and Facebook have dual classes of shares and all shareholder governance is controlled by the founders.