ggerganov

12 ms·

1. 91.▲
   by ggerganov 4y ago

   Recently, I've been implementing my custom inference code in C for various models (GPT, Whisper) and am interested to see how it compares to various GPUs in terms of performance. So far, I've been running it only on my MacBook M1
2. 92.▲
   by ggerganov 4y ago

   Thank you - much appreciated :)
3. 93.▲
   by ggerganov 4y ago

   Hi, this is an implementation from scratch - the goal was to become more familiar with how the transformer model works. Also, I implemented inference of the GPT-J model which is quite similar to GPT-2 - it's another example in the same
4. 94.▲
   Show HN: GPT-2 inference on the CPU using C/C++(github.com)

   3 points by ggerganov 4y ago|1 comments
5. 95.▲
   Show HN: GPT-J inference on the CPU using C/C++(github.com)

   5 points by ggerganov 4y ago|2 comments
6. 96.▲
   by ggerganov 4y ago

   The model is 4GB, not 4TB
7. 97.▲
   HNGuessr – Guess the Hacker News Titles(hnguessr.ggerganov.com)

   1 points by ggerganov 4y ago|0 comments
8. 98.▲
   by ggerganov 4y ago

   Hi HN, I did this little project over the weekend and thought you might find it fun. It's a mock UI for Slack running in the terminal. The demo is written in C++ using ImTui. You can quickly give it a try via the Emscripten port [0]. C
9. 99.▲
   Show HN: Text-based UI (TUI) for a Slack client (mock)(github.com)

   1 points by ggerganov 4y ago|1 comments
10. 100.▲
    by ggerganov 4y ago

    I've been programming in Vim for a very long time and even though I use some of the available jump commands, I still find it very useful to have a fast key repeat rate. In most cases it's simply faster to start going to where I wa
11. 101.▲
    by ggerganov 4y ago

    I'm just very used to the fast repeat rate on my Ubuntu workstation and recently started using my MacBook. I like having high repeat rate because it allows me to navigate much faster in my editor while developing stuff.
12. 102.▲
    Ask HN: Increase Key Repeat rate on Mac OS beyond normal limits

    5 points by ggerganov 4y ago|4 comments
13. 103.▲
    by ggerganov 4y ago

    Hi HN, I recently ported my data-over-sound library called "ggwave" to run on microcontrollers and I though it might be of interest for people working on various IoT project. Below are some technical details and if you just want a
14. 104.▲
    Show HN: GGWave – Data over Sound for Microcontrollers(github.com)

    4 points by ggerganov 4y ago|1 comments
15. 105.▲
    by ggerganov 4y ago

    Tangentially related - you can play a turn-based Doom (1993) on Twitter: https://twitter.com/tweet2doom/status/1444355917160534024 There is a tree explorer that shows you all moves that have been played so far by
16. 106.▲
    by ggerganov 4y ago

    There is a "Boxart" button at the bottom of the page to toggle between pure ASCII chars and "extended" ASCII (not sure what is the proper name).
17. 107.▲
    by ggerganov 4y ago

    The way I use ASCII art diagrams in my source-code is through this simple web service that I hosted: https://dot-to-ascii.ggerganov.com I generate the ASCII graph and then paste it in the comments together with a link to the ser
18. 108.▲
    by ggerganov 4y ago

    $10/month is a perfect price - that was my exact estimate of what I was willing to pay for this service when it becomes non-free. To everyone expecting Copilot to magically write the code they are thinking about - you are missing the p
19. 109.▲
    by ggerganov 4y ago

    I don't know the paper, but I'm actually working on an Arduino library for data over sound and I think it kind of sounds similar to R2D2. Here is a 1 min demo if you are interested: https://www.youtube.com/watch?v=
20. 110.▲
    by ggerganov 4y ago

    Hey, author here - great to see this posted on HN again. Let me know if you have any questions. I notice comments that the approach is not working for various setups. I recommend starting with the most simple test - using Keytap [0] and tra
21. 111.▲
    by ggerganov 4y ago

    Allegedly, based on info from a DALL-E 2 paper, it takes about 100k-200k GPU hours to train the model: https://github.com/lucidrains/DALLE2-pytorch/issues/22#issue...
22. 112.▲
    Reversing a 2.4GHz Remote Control(xakcop.com)

    159 points by ggerganov 4y ago|28 comments
23. 113.▲
    by ggerganov 5y ago

    I would make a "Show HN" post
24. 114.▲
    by ggerganov 5y ago

    I've been using a similar stack (C++ and WASM) to build some simple applications and I enjoy it very much. For the UI components, text rendering and layout I use Dear ImGui [0] as I am very familiar with it and it allows me to implemen
25. 115.▲
    by ggerganov 5y ago

    Is lvl 23 solvable? I quickly solved 7 levels and then tried doing lvl 23 and have been stuck on it for 10 minutes, always ending up with 2 circles next to each other that I cannot swap. Cool game!
26. 116.▲
    by ggerganov 5y ago

    Yes absolutely! (Edit: or maybe not :-) see sibling comment for more info) Actually, the "Waver" youtube video linked at the top of the README has an embedded ultrasound transmission at around 0:36. I can for example decode the me
27. 117.▲
    by ggerganov 5y ago

    Probably, but I suppose you would need lots of training data in various surrounding conditions and hardware (mic, speakers). I wanted to experiment with using a mic-array in order to improve the SNR. Got a 4 Mic ReSpeaker [0] some time ago,
28. 118.▲
    by ggerganov 5y ago

    If you are interested in transmitting data over sound between airgapped devices, make sure to also checkout ggwave [0]. I've been working on this library on and off during the past year in my free time. I focused on making a FSK protoc
29. 119.▲
    by ggerganov 5y ago

    Another tool similar to this is https://dot-to-ascii.ggerganov.com
30. 120.▲
    by ggerganov 5y ago

    Thanks for the suggestion! Definitely sounds fun :D