joaquincabezas

7 ms·

1. 31.▲
   by joaquincabezas 2y ago

   there is also the joy of experimenting a “new and revolutionary” technology. Although yes, with big tech and big salaries there is an economic incentive
2. 32.▲
   by joaquincabezas 2y ago

   Now that many open source LLMs are already “useful” it is key to ease the development _around_ them, in particular in a way where users-developers can leverage on “private data” (really, data that is not present in the pre-training of these
3. 33.▲
   by joaquincabezas 2y ago

   I’ve already heard a few times that the selection of models is seen as a problem (need to benchmark continually, justify changes…), this is an elegant solution. I don’t know if choosing different models for the same consumer can be problema
4. 34.▲
   by joaquincabezas 2y ago

   I tend to see a price range as a trick to make people think that the lower price is a good deal (hey look today I saved $250M!!)
5. 35.▲
   by joaquincabezas 2y ago

   LLM inference optimization has been key for the OpenAI GPT-4o presentation (2x faster, 50% cheaper) and its driving lots of industry research because it’s direct cost savings, but it’s refreshing to see so many techniques published as paper
6. 36.▲
   by joaquincabezas 2y ago

   I normally use Netron for quickly inspecting models and making this 'mental picture' of the architecture, but this hierarchical approach seems a better fit for my needs. I'm just starting and the first impression is pretty go
7. 37.▲
   by joaquincabezas 2y ago

   wow their graphs at the GitHub README ( https://github.com/HazyResearch/ThunderKittens/blob/main/att... ) make me extremely dizzy. Are these wavy bars even legal? :P
8. 38.▲
   by joaquincabezas 2y ago

   I was at ICLR and this was one of the best of this year, it was also evident during the poster session. Congrats to the authors!!
9. 39.▲
   by joaquincabezas 2y ago

   During the first year of my PhD I tried building metrics for interpretability of Graph Neural Networks… kind of obsessed about having “measurable” properties because I thought that was the “science way”. I failed every single try, and after
10. 40.▲
    by joaquincabezas 3y ago

    it looks like TensorRT-LLM (TRT-LLM) is the way to go for a realtime API for more and more companies (i.e perplexity ai’s pplx-api, Mosaic’s, baseten…). Would be super-nice to find people deploying multimodal (i.e LLaVA or CLIP/BLIP) t
11. 41.▲
    by joaquincabezas 3y ago

    this keeps coming… recently there’s been a bit of debate between Milvus and Qdrant on this topic: https://www.linkedin.com/posts/yujiantang_how-can-you-judge-...
12. 42.▲
    by joaquincabezas 3y ago

    PaddleOCR works pretty well, how are you planning to integrate it in your workflow? I found huge differences in throughput between python serving and frameworks (i.e. NVIDIA Triton Inference Server).
13. 43.▲
    by joaquincabezas 3y ago

    are there also experiments around image embedding generation to use in combination with the LLM? maybe for this use-case is it better to execute the vision tower on a GPU and leave the LPU for the language part?
14. 44.▲
    by joaquincabezas 3y ago

    Also discussed at: https://news.ycombinator.com/item?id=38870249
15. 45.▲
    by joaquincabezas 3y ago

    and without ChatGPT…
16. 46.▲
    by joaquincabezas 3y ago

    Thanks a lot for the material Varun, neat presentation with exhaustive computations that make it easy to follow. Question on the serving part: vLLM, Deepspeed, TensorRT-LLM... ? Thanks!
17. 47.▲
    by joaquincabezas 3y ago

    imagine being in the last round of interviews for joining OpenAI…
18. 48.▲
    by joaquincabezas 3y ago

    Totally recommend that book!!
19. 49.▲
    by joaquincabezas 3y ago

    I found this a few years ago at https://stackoverflow.com/questions/14754762/can-gitconfig-o... and has been my preferred setup.
20. 50.▲
    by joaquincabezas 3y ago

    I was always curious about the original cells of the parents (or more specifically the molecules forming it). Are they somehow “staying” in the baby?
21. 51.▲
    by joaquincabezas 3y ago

    reading frequently on HN how COBOL is still running critical tasks, I would rather say "for fun and profit"
22. 52.▲
    by joaquincabezas 3y ago

    Is this the real life? Is this just fantasy?
23. 53.▲
    by joaquincabezas 3y ago

    > and found myself nodding my head in vigorous agreement. s/he who is without sin… Our IoT device was not selling well because it lacked one RS-485 port… and then a 4-20mA interface, and then…
24. 54.▲
    by joaquincabezas 3y ago

    Did you finally select it? Our team is using PaddleOCR with good results! We wrote an article ( https://medium.com/adevinta-tech-blog/text-in-image-2-0-impr... ) about it.
25. 55.▲
    by joaquincabezas 3y ago

    all you need is emergent anything
26. 56.▲
    by joaquincabezas 4y ago

    fn main() { println!("Too late I guess!"); }
27. 57.▲
    by joaquincabezas 4y ago

    I keep saving these Rust resources for a near future... Am i the only one?? I really hope to start using Rust in 2023, probably for some kind of API gateway experimentation
28. 58.▲
    by joaquincabezas 4y ago

    Check https://logconference.org/schedule-tutorials/#neural-algorit... for a tutorial happening in less than 24 hours. LoG conference is free to attend and online :)
29. 59.▲
    by joaquincabezas 4y ago

    I am really curious about Rust after looking for API proxies (in particular Linkerd2 - https://github.com/linkerd/linkerd2-proxy ). Can anyone share her/his experience on going from Python to Rust? (bonus point if
30. 60.▲
    by joaquincabezas 4y ago

    I remember a long time ago, reading about Semantic Web and intelligent agents and dreaming of a Natural Language interface for planning journeys… “I want to travel from Seville to Berlin next October, avoiding weekends, for a two or three n