dandiep

10 ms·

31.
by dandiep 3y ago
It’s important to remember that GPT4 is only deterministic at the batch level because it is a mixture of experts model. Basically every time you invoke it, your query could get routed to a different expert because of what else is in the bat
32.
by dandiep 3y ago
Totally, just trying to understand why this is a $100MM of VC money investment. Is the market that big for this? (Honest question)
33.
by dandiep 3y ago
I don't understand the play here for Modular. If this is a worthwhile improvement that is broadly applicable, won't it at some point make it's way into Python, numpy, etc? In Java land we had a bunch of other JVMs over the ye
34.
by dandiep 3y ago
Can you elaborate on this? Would love to understand how that would play out.
35.
by dandiep 3y ago
I think https://elicit.org/ is also worth a mention in this context.
36.
by dandiep 3y ago
Costs really aren’t a concern compared to speed of development and quality.
37.
by dandiep 3y ago
I'm building a webapp backend in Python right now and the ecosystem compared to Java is just horrendous. * Maven (or at the very least transitive dependency management) is a defacto standard. While some solutions exist such as Poetry,
38.
by dandiep 3y ago
Using GPT3.5/4 in our language learning app and people seem to enjoy it. [1] Tried Llama2 and it definitely doesn’t even come close for what we’re doing. Would absolutely need fine tuning. Maybe customers don’t enjoy chat bots for cust
39.
by dandiep 3y ago
Who here is using Claude? And can you comment on your experiences with it vs. GPT 3.5/4?
40.
by dandiep 3y ago
I'm curious, do you have any concerns in unleashing LLMs in front of your kids? I ask this as someone with no kids who is working on a language learning app that does essentially what you're talking about [1]. We have only done a
41.
Pgvector now available on AWS RDS(twitter.com)
1 points by dandiep 3y ago|0 comments
42.
by dandiep 4y ago
I really don't want another database. I just want to have a solution built in for Postgres, and more specifically, RDS, which we use. I know there will be some extra difficulty that I will have to manage (e.g. reindexing to a new model
43.
by dandiep 4y ago
Thank you for this!
44.
by dandiep 4y ago
Yes, however, it can generate a training dataset to fine tune a smaller model really cheaply, which can then scale.
45.
by dandiep 4y ago
There is no such thing as davinci-003 per se. There is text-davinci-003 which you can't fine tune, and davinci which you can.
46.
by dandiep 4y ago
Does anyone known if OpenAI is allowing fine tuning to GPT35 for foundry customers?
47.
by dandiep 4y ago
Also, there's a huge difference between "it works for an ML benchmark" and "it works for real life use cases". OpenAI has done a phenomenal job with instruction tuned models, enabling fine tuning for any use case ve
48.
by dandiep 4y ago
Does OpenAI provide guarantees now around fine tuned models being loaded 24/7? Last time I fine tuned Curie models they took forever to load and that killed it for me as we’re building an interactive application.
49.
by dandiep 4y ago
A couple points which I don't see elsewhere: 1) They have the best quality model. Better quality means more users. More users means more data. Which means higher quality... 2) operationalizing & scaling these these models is non-tr
50.
by dandiep 4y ago
Temperature = 0 solves a lot of it, but not all. A list of all options solves a portion of the remaining. Not sure what to do about the rest - maybe ask the LLM?
51.
by dandiep 4y ago
Yes.
52.
by dandiep 4y ago
Awesome... but I can't tell from your website what exactly it is.
53.
by dandiep 4y ago
There's a lot of work going on in this area right now. Check out GPT Index: https://github.com/jerryjliu/gpt_index https://github.com/jerryjliu/gpt_index/blob/main/examples&#x2F
54.
by dandiep 4y ago
LangChain is very cool. Templates and composability are the way forward. I'm guessing that most folks haven't created composable prompts, so a few experiences on why this stuff is necessary. I've been building a language lear
55.
by dandiep 4y ago
Perhaps, but language is the common denominator in a multi-model world. E.g., I pass the GPT output into other models which are fine tuned for that sub domain. You can do embedding to embedding conversion, but not sure it's worth the e
56.
by dandiep 4y ago
Also, a pretty sophisticated way to manage transitive dependencies. Python is an absolute mess in this regard (as well as pretty much everything else with dependency management…)
57.
by dandiep 4y ago
100% agree with this. In the early phases (in my experience) encountering of new word drastically outpaces your ability to do flashcards. And this is fine! Then, as you progress, you don't don't need to review every damn flashcard
58.
by dandiep 4y ago
I have been working on a form of this for a language learning app [1]. The basic idea is that it gets you do free form output (discussion questions, word games, etc), gives you feedback on where you have errors and then sets up SR flashcard
59.
by dandiep 4y ago
Apologies - this wasn't clear. I didn't mean to say we generalize to all cases. I should have said it was more helpful for some of the common cases that plague language learners.
60.
by dandiep 4y ago
I have been a user of the Language Tool API as we're building (experimenting with?) a language learning app [1] and grammar correction is a key component. I really want to love it, and I'm so appreciative of the open source vers

More ›