Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
holomorphiclabs
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
Ask HN: Where to Host an LLM in 2024?
3 points
by
holomorphiclabs
2y ago
|
1 comments
2.
▲
by
holomorphiclabs
2y ago
Thank you! and yes huge fan of r/localllama :)
3.
▲
by
holomorphiclabs
2y ago
Thank you we have been exploring this.
4.
▲
by
holomorphiclabs
2y ago
Our findings are that RAG does not generalize well when critical understanding is shared over a large corpus of information. We do not think it is a question of either context length or retrieval. In our case it is very clearly capturing un
5.
▲
by
holomorphiclabs
2y ago
We are finding there is a trade-off between model performance and hosting costs post-training. The optimal outcome is where we have a model that performs well on next-token prediction (and some other in-house tasks we've defined) that
6.
▲
by
holomorphiclabs
2y ago
Are there any that are recommended? Honestly we would rather not share data with any 3P vendors. It's been a painstaking progress to curate it.
7.
▲
Ask HN: Most efficient way to fine-tune an LLM in 2024?
114 points
by
holomorphiclabs
2y ago
|
48 comments