jaywonchung

5 ms·

1.
Cornserve: Serving multimodal AI models like microservices(cornserve.ai)
1 points by jaywonchung 11mo ago|0 comments
2.
Andes: Optimizing the QoE of LLM text streaming services(llm-qoe.github.io)
1 points by jaywonchung 2y ago|0 comments
3.
Colosseum: Real time LLM serving energy comparison(ml.energy)
1 points by jaywonchung 3y ago|0 comments
4.
by jaywonchung 3y ago
Wow this is awesome. Thanks a lot for sharing! I've always been meaning to try out Obsidian. Looks like this could be a good chance.
5.
by jaywonchung 3y ago
Right, fair question. I've tried many reference managers over several years but not one of them really felt like home. Their PDF viewer was lacking the features I wanted (e.g., jumping back to the original place after clicking an inter
6.
by jaywonchung 3y ago
Ah, integration with other tools is currently what I didn't think about too much, but I completely agree with the need. People usually have their own way to manage references. Basically all of the states of Reason (i.e., the paperbase)
7.
Pegasus: A Multi-Node SSH Command Runner in Rust(github.com)
2 points by jaywonchung 3y ago|0 comments
8.
Reason: A Shell for Research Papers in Rust(github.com)
27 points by jaywonchung 3y ago|6 comments
9.
by jaywonchung 3y ago
Yep, I completely agree with your first paragraph, and adding quantization & distributed inference is one of the bigger next steps. Adding numbers from consumer GPUs would be nice for non-data center use cases, too. Decoder-only models
10.
An energy-efficiency leaderboard for LLMs(ml.energy)
1 points by jaywonchung 3y ago|2 comments
11.
Deep Learning consumes too much energy, but `Zeus` is here to help(ml.energy)
1 points by jaywonchung 3y ago|0 comments