Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
namanski
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
1.
▲
by
namanski
2y ago
I've built a product in this regard - specifically for fine-tuning and deploying said fine-tuned models. You'll need GPUs for inferencing + have to quantize the model + have it hosted on the cloud. The platform I've built is
2.
▲
by
namanski
2y ago
I'm a tech founder who has raised money from VCs in India. For some reason, I feel like I know the 'syndicate' you're talking about. If you're okay sharing, are they Mumbai-based? After running my co. for over half
3.
▲
by
namanski
2y ago
Hey Christoph, thanks for trying it out - we're running this on the cloud, particularly GCP, on A100s (80g). On your query about running these models locally, I'm not sure if just upgrading your RAM would have the same throughput
4.
▲
by
namanski
2y ago
I just hosted both models here: https://chat.tune.app/ Playground: https://studio.tune.app/
5.
▲
by
namanski
2y ago
I've been using Otter AI for almost a year now. They've added quite a few features with querying your transcription and the likes, and it just works. Specifically on language, it sometimes goes haywire when there is Hinglish (Hind
6.
▲
by
namanski
2y ago
Some marketing bro probably wrote that copy without thinking about it. Good explanation though.
7.
▲
by
namanski
2y ago
Pretty cool! I like how each colour has its own name.
8.
▲
100M tokens free, models upto 240B – LLM Fine-tuning and deployment platform
(tunehq.ai)
2 points
by
namanski
3y ago
|
1 comments
9.
▲
by
namanski
3y ago
Hey hackers, I just built and released Tune Studio for fine-tuning and deploying open source LLMs. After building an entire MLOps stack, we pivoted and retrofitted it for GenAI models. Currently only for large-language models. Feedback welc
10.
▲
ChatGPT Plus sign-ups are on hold: Try ChatNBX Plus instead
(chat.nbox.ai)
1 points
by
namanski
3y ago
|
1 comments
11.
▲
by
namanski
3y ago
We've hosted a plethora of open-source LLMs and you can generate images with SDXL seamlessly.
12.
▲
by
namanski
3y ago
Yeah - It's at par, if not better than GPT 3.5! This is the base model (13B) with no fine-tuning or censorship. Feel free to give it a spin for code as well! We're just the infrastructure layer here so we don't use any data f
13.
▲
by
namanski
3y ago
Hey hey! We have deployed this on our cloud. It’s running on 2 A10Gs on AWS in the background. We had the tech from our MLOps platform NimbleBox.ai that let us setup a managed service on all major cloud providers so we just frankenstein-ed
14.
▲
Show HN: ChatGPT Alternative with LLaMA Models
(chat.nbox.ai)
20 points
by
namanski
3y ago
|
10 comments
15.
▲
Where do you see LLMs heading towards?
1 points
by
namanski
3y ago
|
1 comments
16.
▲
by
namanski
3y ago
I believe it's the way OpenAI has positioned its model. By itself, the model follows a straightforward and concise 'answer the question' approach. However, if you want it to be creative, scientific, or empathetic, you can eng