holomorphiclabs

4 ms·

1. 1.▲
   Ask HN: Where to Host an LLM in 2024?

   3 points by holomorphiclabs 2y ago|1 comments
2. 2.▲
   by holomorphiclabs 2y ago

   Thank you! and yes huge fan of r/localllama :)
3. 3.▲
   by holomorphiclabs 2y ago

   Thank you we have been exploring this.
4. 4.▲
   by holomorphiclabs 2y ago

   Our findings are that RAG does not generalize well when critical understanding is shared over a large corpus of information. We do not think it is a question of either context length or retrieval. In our case it is very clearly capturing un
5. 5.▲
   by holomorphiclabs 2y ago

   We are finding there is a trade-off between model performance and hosting costs post-training. The optimal outcome is where we have a model that performs well on next-token prediction (and some other in-house tasks we've defined) that
6. 6.▲
   by holomorphiclabs 2y ago

   Are there any that are recommended? Honestly we would rather not share data with any 3P vendors. It's been a painstaking progress to curate it.
7. 7.▲
   Ask HN: Most efficient way to fine-tune an LLM in 2024?

   114 points by holomorphiclabs 2y ago|48 comments