FezzikTheGiant

6 ms·

1. 31.▲
   Ask HN: Downloading 200M Files Fast

   6 points by FezzikTheGiant 2y ago|7 comments
2. 32.▲
   by FezzikTheGiant 2y ago

   How feasible would running a local gpt2 fine-tune be on m1/m2 macs. The usecase I'm building for has privacy as a pretty big need, so I need to ensure the data never leaves the user's machine.
3. 33.▲
   Ask HN: Running LLMs Locally

   1 points by FezzikTheGiant 2y ago|3 comments
4. 34.▲
   by FezzikTheGiant 2y ago

   Thanks! Will def try building one just for fun
5. 35.▲
   by FezzikTheGiant 2y ago

   how much does it cost
6. 36.▲
   by FezzikTheGiant 2y ago

   Just curious looking at this, can any decent programmer build at least an extremely simple version of this? Considering whether it would be cool as a summer project.
7. 37.▲
   by FezzikTheGiant 2y ago

   this is a great resource nonetheless. Even if you did use the name to get attention how does it matter? I still see it as a net positive. Thanks for sharing this
8. 38.▲
   Ask HN: What's Happening with LLMs and Indie Games

   1 points by FezzikTheGiant 2y ago|1 comments
9. 39.▲
   by FezzikTheGiant 2y ago

   I was on the site and I can't see any demos at all. No one's gonna drop $29 on this without knowing what it does
10. 40.▲
    by FezzikTheGiant 2y ago

    lmao fair enough
11. 41.▲
    by FezzikTheGiant 2y ago

    Thanks. Very cool. Have you ever tried to implement a transformer from scratch? Like in the Attention is all you need paper? Can a first/second year college student do it
12. 42.▲
    by FezzikTheGiant 2y ago

    Thanks!! This is really cool
13. 43.▲
    by FezzikTheGiant 2y ago

    Interesting. Thanks for the response. Do you have any resources where I can educate myself about this? How did you learn what you know about LLMs?
14. 44.▲
    by FezzikTheGiant 2y ago

    This is cool. Is there a mobile app?
15. 45.▲
    by FezzikTheGiant 2y ago

    This might be asking for too much but is there a guide that explains each part of this process? Your comment made the higher level way clearer for me and I'd like to go into the weeds a bit on each of these
16. 46.▲
    by FezzikTheGiant 2y ago

    Thanks for the insightful response. This is exactly the type of answer I was looking for. What's the best way to educate myself on the end-to-end process of deploying a production grade model smartly in a cost efficient manner?
17. 47.▲
    by FezzikTheGiant 2y ago

    This is really helpful. I'm really new to this, what's the best way to educate myself on fine-tuning and deploying a LLM in the most cost and time efficient way?
18. 48.▲
    by FezzikTheGiant 2y ago

    Appreciate the response. Definitely gonna check it out. How is pricing structured
19. 49.▲
    Ask HN: How does deploying a fine-tuned model work

    124 points by FezzikTheGiant 2y ago|64 comments
20. 50.▲
    by FezzikTheGiant 2y ago

    Hey, I replied to your comment about building an open source version of Aqua Voice. Emailed you about it too. Let me know your thoughts.
21. 51.▲
    by FezzikTheGiant 2y ago

    I'm thinking of building something like this over the summer, an open-source alternative that is integrated into desktop with a community effort on building a training data source. However the biggest concern is that it would cost a lo
22. 52.▲
    by FezzikTheGiant 2y ago

    Perfect. I have my own finals in a couple weeks haha, planning to look more into this and possibly build a project over the summer. 3B1B's videos sound like a good resource, and the nano-GPT videos look really useful too. I'll sha
23. 53.▲
    by FezzikTheGiant 2y ago

    What valuable differences would an open source version have over aquavoice? Why do you need an open source version?
24. 54.▲
    by FezzikTheGiant 3y ago

    Is this all the math that is required? If I know how to do basic linalg is that about what I need to know to be able to understand how LLMs work? My goal right now is to build stuff on top of LLMs
25. 55.▲
    by FezzikTheGiant 3y ago

    I'm in the exact same situation as you rn. Freshman year of college and really interested in LLMs. Did you decide how you're gonna go about it? Maybe we could share resources
26. 56.▲
    by FezzikTheGiant 3y ago

    I'm in the exact same situation as the poster rn. Freshman year of college and really interested in LLMs. I'm planning to take ML/Deep learning courses at my school later on, but in the meantime, what would be the best way to
27. 57.▲
    by FezzikTheGiant 3y ago

    How should I go about building one?
28. 58.▲
    by FezzikTheGiant 3y ago

    what about hosting? how would you recommend doing that
29. 59.▲
    by FezzikTheGiant 3y ago

    Thanks for the info! Appreciate it
30. 60.▲
    by FezzikTheGiant 3y ago

    So I can run local LLMs on my apple M1 air?