3 ms·

Totally fine, thanks for trying it out. The idea is this "identity card", which is super early in our dev process. The goal is to make it so you can have your

Totally fine, thanks for trying it out. The idea is this "identity card", which is super early in our dev process. The goal is to make it so you can have your voice as a thoroughly vetted example, and then be able to use that to finetune LLMs, or use it at inference time to enhance LLM outputs to sound more like you. We'll be building out a full CMS, and shipping parts of it over time. Thanks again, it's super early but we're working on it. :)

jmuguy 2y ago
Ah, I'm not much of an AI person so I'm probably just lacking context. Regardless I do think it would be helpful to point out - your second paragraph refers to "the tooling" and that you're focused on "showing the dev experience and community aspects". I don't really see how your site or the demo you're showing actually highlights either of those things.
- randall 2y ago
  Yeah, honestly this might have been too early of a launch, but kind of just want to put something out and then iterate.
fallinditch 2y ago
> you can have your voice as a thoroughly vetted example, and then be able to use that to finetune LLMs You have piqued my interest. Can you explain in more detail how a user will fine tune a model. Will the LLM just replicate a user's conversational style? Or will the user be able to set deeper parameters, for example to define goal-oriented outputs for agentic actions?
- randall 2y ago
  So the goal initially is going to be to create a "constitution." Basically a document that outlines your voice, or whatever. From there, you can create examples for every sentence and classify them... ie "this is a good example" or "this is almost a good example." Then, after you have a good enough enough number of human versions (idk this number yet), you can use those to create dozens more examples, refine, etc... then at some point you've thoroughly described a document enough that there's no more delta. Then you can use the document to train / finetune / infer. The effects are that the "instincts" of the model (if on the training / weights) or the "thoughts" of the model (at inference time) are closer to a well vetted baseline.

jmuguy 2y ago

Ah, I'm not much of an AI person so I'm probably just lacking context. Regardless I do think it would be helpful to point out - your second paragraph refers to "the tooling" and that you're focused on "showing the dev experience and community aspects". I don't really see how your site or the demo you're showing actually highlights either of those things.

randall 2y ago
Yeah, honestly this might have been too early of a launch, but kind of just want to put something out and then iterate.

fallinditch 2y ago

> you can have your voice as a thoroughly vetted example, and then be able to use that to finetune LLMs You have piqued my interest. Can you explain in more detail how a user will fine tune a model. Will the LLM just replicate a user's conversational style? Or will the user be able to set deeper parameters, for example to define goal-oriented outputs for agentic actions?

randall 2y ago
So the goal initially is going to be to create a "constitution." Basically a document that outlines your voice, or whatever. From there, you can create examples for every sentence and classify them... ie "this is a good example" or "this is almost a good example." Then, after you have a good enough enough number of human versions (idk this number yet), you can use those to create dozens more examples, refine, etc... then at some point you've thoroughly described a document enough that there's no more delta. Then you can use the document to train / finetune / infer. The effects are that the "instincts" of the model (if on the training / weights) or the "thoughts" of the model (at inference time) are closer to a well vetted baseline.