pama

42 ms·

1. 781.▲
   by pama 3y ago

   I occasionally used to start a sync, go get coffee, chat with colleagues, read and answer my morning email, browse the arxiv, and then wait a few more minutes before I could touch the repo. In retrospect, I should have setup a cron job for
2. 782.▲
   by pama 3y ago

   I don’t like hypothetical counterfactuals but of course it is your choice to use them. It is hard to meaningfully compare recent programs, rust or otherwise, with established behemoths like Linux, gcc, Emacs, etc, that did the heavy liftin
3. 783.▲
   by pama 3y ago

   Yes that is the example for small molecules. One can generalize to other graphs as well.
4. 784.▲
   by pama 3y ago

   This is a personal impressionistic opinion, so please take it as such and don’t expect citations or details. It has been empirically clear since the inception of GNN that the message passing structure and forced equivariance would make it h
5. 785.▲
   by pama 3y ago

   If one is training the full 70B parameters, then the total memory usage far exceeds the memory for simply storing the 70B parameters (think derivatives and optimizer parameters such as momentum.) This is the main reason why models are split
6. 786.▲
   by pama 3y ago

   With a lockdown-enabled iPhone I only get a loading page that says chrome highly recommended.
7. 787.▲
   by pama 3y ago

   Agreed. I don’t understand the trend for abstracting away the best possible human interface.
8. 788.▲
   by pama 3y ago

   Just noting for my own reference that the TH1520 is well within the interesting range.
9. 789.▲
   by pama 3y ago

   Thanks. So some of these cpu, say VisionFive 2 U74, start to look interesting.
10. 790.▲
    by pama 3y ago

    I hope that more people try Emacs after having had exposure to vscode. It may be slow to get to know the new environment, and reading the manual only takes one so far, but Everything becomes nicer after the training phase. Text-based remote
11. 791.▲
    by pama 3y ago

    Is there any good benchmark/comparison of the current risk-v boards for use in hobby projects?
12. 792.▲
    by pama 3y ago

    This is an implementation of GPT using the pytorch library. It is not meant to be the shortest implementation of a trainable GPT, however it is very clean code. Pytorch does a lot of the heavy lifting, especially when it comes to training o
13. 793.▲
    by pama 3y ago

    Footnote in the Supreme Court opinion: “The term 'security' means any note, stock, treasury stock, bond, debenture, evidence of indebtedness, certificate of interest or participation in any profit-sharing agreement, collateral tru
14. 794.▲
    by pama 3y ago

    Here is what SOC2 means. I hope this allows more companies to offer GPT-4 to their employees. https://en.wikipedia.org/wiki/System_and_Organization_Contro...
15. 795.▲
    by pama 3y ago

    I agree, however the next step would be to symmetrize the KL divergence because otherwise we get a result that depends on the order that we parse the distributions.
16. 796.▲
    by pama 3y ago

    Thanks. That 600% total estimate is much closer to what I expected. Don’t get me wrong. I admire bacteria but they are nowhere near as efficient as your initial comment suggested.
17. 797.▲
    by pama 3y ago

    I work in related areas but have never heard of such bacteria. Typical evolution starts with barely workable designs and then lots of things get added on top to add robustness or efficiency. Bacterial engines and enzymes are very primitive
18. 798.▲
    by pama 3y ago

    I like how computational results occasionally generate unexpected answers that drive mathematicians to work out new theories.
19. 799.▲
    by pama 3y ago

    I’m not one of the authors and have only skimmed the paper thus far and found it interesting enough to warrant further study. I guess one could run the simulation in the hardware and monitor convergence as a function of time. I can also ima
20. 800.▲
    by pama 3y ago

    Thanks!
21. 801.▲
    by pama 3y ago

    Thanks. Do you have somewhere a demo of the hardware performing these computations?
22. 802.▲
    by pama 3y ago

    Other than simulating the Hamiltonian on a digital computer, are there any prototype hardware devices that can perform this computation?
23. 803.▲
    by pama 3y ago

    It appears like a very poor analysis overall. These closing arguments suggest lack of deep thinking: “Consider Alphabet, the parent company of Google DeepMind. Alphabet is not constrained by financial capital: as of March 2023, Alphabet ha
24. 804.▲
    by pama 3y ago

    I do not think that blog posts have any legal value whatsoever. The current terms of service are too risky for most companies who would otherwise have loved to continue to be users of your product.
25. 805.▲
    by pama 3y ago

    Looks great. Has anyone tried an integration with Emacs?
26. 806.▲
    by pama 3y ago

    Just a word of caution that Wikipedia entries around LK99 are unusually poor at this point in time. The citation of an attempt to publish it in Nature in 2020 is completely made up when the original Korean only mentions in passing a comple
27. 807.▲
    by pama 3y ago

    I'm also very happy with Emacs' continued existence. Frankly, I don't know what I'd do without M-x shell plus related hacks, but I think I'd have to reinvent the concept of having arbitrary numbers of named shells
28. 808.▲
    by pama 3y ago

    Agreed. Feeding the GPUs with multiple forked memory-hogging processes is no fun and leads to annoying hacks. And, yes, as per your other post, there could have been other solutions to this problem, some of which might have been better.
29. 809.▲
    by pama 3y ago

    Great job, thanks! Do you have any early impressions on the relative quality/performance of small lama-2 models vs the small gpt-2 models?
30. 810.▲
    by pama 3y ago

    I didn’t downvote, FWIW. I am also not asking for a chip. I wonder if it’s possible to solve a specialized problem with this type of computing, maybe something that right now is not addressed well, for example applications in quantum chemi