Kinrany

35 ms·

1. 721.▲
   by Kinrany 4y ago

   Thanks. If you don't mind, what's the size of your individual files, and how many of them does it take to serve a single request: one, a few, N?
2. 722.▲
   by Kinrany 4y ago

   Heh, ask me in a few months when I'm done with the current thing :P
3. 723.▲
   by Kinrany 4y ago

   Thank you! I was planning to try using DataFusion to query large parquet files without retrieving them from s3 with https://github.com/datafusion-contrib/datafusion-objectstore... . I guess I should expect that that won
4. 724.▲
   by Kinrany 4y ago

   How are you using Datafusion? And overall, very interested in hearing about your experience. What does the whole stack/pipeline look like?
5. 725.▲
   by Kinrany 4y ago

   What are your requirements, and how do you store and load the data? Are you doing anything to select only the relevant parts of the parquet files?
6. 726.▲
   Google Scholar Blog: Classic Papers: Articles That Have Stood the Test of Time(scholar.googleblog.com)

   4 points by Kinrany 4y ago|0 comments
7. 727.▲
   by Kinrany 4y ago

   Using or not using paper is not at all similar to working out or resting. When you're thinking with paper in front of you, you're free to not use paper or switch back and forth in a matter of seconds. It's a strict improvemen
8. 728.▲
   by Kinrany 4y ago

   Thinking with paper is very obviously better than keeping all the thoughts in your head.
9. 729.▲
   The “Minimal Latents” approach to natural abstractions(lesswrong.com)

   5 points by Kinrany 4y ago|0 comments
10. 730.▲
    by Kinrany 4y ago

    The need to make money is not a universal defense of anything that makes money.
11. 731.▲
    by Kinrany 4y ago

    > Take back control Oh jeez, will every marketing copy repeat this phrase forever now?
12. 732.▲
    by Kinrany 4y ago

    And you can give every candidate a new version of it.
13. 733.▲
    by Kinrany 4y ago

    The main benefit of social networks is secure messaging. All the other features require a combination of a sophisticated frontend and a sufficiently general authorization mechanism. One crazy idea is to build a basic messenger and let the u
14. 734.▲
    We Failed Agile(goretro.ai)

    3 points by Kinrany 4y ago|0 comments
15. 735.▲
    by Kinrany 4y ago

    We also know that centralizing violence is not necessary for minimizing it: there is no world government that regulates all violence, yet countries mostly manage to avoid wars.
16. 736.▲
    by Kinrany 4y ago

    If government regulates violence, it also necessarily authorizes violence. There's no neutral way to make the choice of which violence to authorize.
17. 737.▲
    by Kinrany 4y ago

    SQLite has a big advantage over Postgres here if installing an extension is trivial.
18. 738.▲
    by Kinrany 4y ago

    You seem to be treating fiction as if it was representative of the real world.
19. 739.▲
    by Kinrany 4y ago

    Even in gaming modding is still somewhat niche.
20. 740.▲
    by Kinrany 4y ago

    Would that be worse than the current disaster though?
21. 741.▲
    by Kinrany 4y ago

    Administration has no clue which projects are good and which "scientists" won't spend the money on a sea of booze. Two mechanisms should be used: 1. Administration decides which projects had real world effect, years or even d
22. 742.▲
    by Kinrany 4y ago

    This is a very cool vision but it sounds like a lot of research, and they probably have many lower-hanging fruit to pick before that!
23. 743.▲
    Standard Readme(github.com)

    2 points by Kinrany 4y ago|0 comments
24. 744.▲
    by Kinrany 4y ago

    It's not honesty or accuracy, it's a misunderstanding of the way language works.
25. 745.▲
    by Kinrany 4y ago

    This is a fully general argument for debugging in production.
26. 746.▲
    by Kinrany 4y ago

    Libraries simplify ops compared to external services, including local development. An embedded database can be used in unit tests with zero effort.
27. 747.▲
    by Kinrany 4y ago

    Automation is merely a tool. There's little difference between running a script and clicking "download" blindly a thousand times.
28. 748.▲
    by Kinrany 4y ago

    That's not a problem if the server owners don't have any power over users.
29. 749.▲
    by Kinrany 4y ago

    This seems like a good idea. The consumer gets a discount, the store gets high quality info about future demand.
30. 750.▲
    by Kinrany 4y ago

    https://documentation.divio.com/ seems to be talking about the same system.