killthebuddha

12 ms·

91.
by killthebuddha 3y ago
Awesome! I similarly blew it by not mentioning that I think this is an awesome project. I bet tons of people have been similarly inspired by the book and by Penrose (I know I have) but you've actually gone out and done a thing, mad kud
92.
by killthebuddha 3y ago
It feels a little bit odd that a newsletter + project that's directly motivated by Penrose's book and also appropriates the book's title does not mention the book. For example, the GitHub repo's readme: Welcome to th
93.
by killthebuddha 3y ago
I think you might have committed a straw man error. My point is not that approximate or vague language is always good, it's that it's sometimes good. Sometimes imprecise communication is good and useful, sometimes it's double
94.
by killthebuddha 3y ago
IMO the argument is sound in one direction: the precision, structure, and unforgiving nature of programming languages is a feature rather than a bug. That said, I think this does not mean that there is no benefit to natural language interfa
95.
by killthebuddha 3y ago
I'm not an outsider but I also don't understand the reaction. I'm going to randomly think of 5 names for technologies and see how they sound: React, Supabase, Next, Kafka, Redis I mean, IMO "LangChain" is kind of a
96.
by killthebuddha 3y ago
I agree, it looks great. A couple similar projects you might find interesting: - https://github.com/newhouseb/clownfish - https://github.com/r2d4/rellm The first one is JSON only and the second on
97.
by killthebuddha 3y ago
I'm skeptical that the streaming API would really save that much cost. In my experience the vast majority of all tokens used are input tokens rather than completed tokens.
98.
by killthebuddha 3y ago
This looks really interesting, great work! Is there somewhere in the docs that describes the essence of how LMQL works? My initial assumption was that it's a compiler that transforms LMQL queries into prompts, but then I realized that
99.
by killthebuddha 3y ago
I think it makes a lot of sense in theory to consider adding CPUs as horizontal scaling, but in practice I'm not sure it makes sense. Moving your app to a machine with twice as many CPUs is more like moving it to a machine with twice a
100.
by killthebuddha 3y ago
I meant vertical scaling, but it sounds like our understanding of vertical scaling is different. My framing is "horizontal scaling = more machines, vertical scaling = more powerful machines". I guess one way to think about it is t
101.
by killthebuddha 3y ago
I love elixir, but I feel like there’s something off about the focus on reliability and error handling. At least for web applications, it’s pretty boring the idea that a single error won’t take down the entire system. At worst, a single err
102.
by killthebuddha 3y ago
For the most part. It’s the system prompt + user/assistant structure that encourages second-person system prompts. You could write a prompt that’s like System: Complete transcripts you are given. User: Here’s a transcript of X But that
103.
by killthebuddha 3y ago
For raw text completion I agree with you that it's a bit discordant. IMO text completion prompts work better when you use more of a first-person, here-is-the-beginning-of-some-transcript style. The OpenAI chat completion endpoint encou
104.
by killthebuddha 3y ago
I'm very unsure that I understand your requirements, but if I squint really really hard it looks like you're asking for a blockchain.
105.
by killthebuddha 3y ago
DISCLAIMER: I think Yudkowsky is a serious thinker and his ideas should be taken seriously, regardless of whether not they are correct. Your comment triggered a random thought: A perfect name for Yudkowsky et al and the AGI doomers is... wa
106.
by killthebuddha 3y ago
> a decline into a contrived and pretentious quest where the artist, instead of attempting to make known the divine plan, tries to put himself in the place of God and 40 years later we have TikTok
107.
by killthebuddha 3y ago
I think this is a great way to think about it. Hallucinations are the default and an LLM app is one that channels hallucinations rather than avoids them.
108.
by killthebuddha 3y ago
Interesting, I didn’t know that.
109.
by killthebuddha 3y ago
I completely agree. IMO anthropomorphisms of LLMs leave out extremely important details.
110.
by killthebuddha 3y ago
A ChatGPT plugin that can answer search queries over your favorite sites would be basically trivial to build and would probably work very, very well. Not only that, but it would be immediately composable with any other ChatGPT plugin. All t
111.
by killthebuddha 3y ago
IMO this leaves out some salient details. For example, I'd say ChatGPT is a very, very good junior developer. The kind of junior developer that loves computer science, has been screwing around with miscellaneous algorithms and data s
112.
by killthebuddha 3y ago
Copilot is highly usable and I'm pretty sure it works the same way.
113.
by killthebuddha 3y ago
Definitely maybe, but also I think pinecone is putting a lot of resources into devrel. For example, see their learning center [1] and examples [2]. Oh man, now I sound like I'm part of the brigading :) FWIW I recently evaluated pinecon
114.
by killthebuddha 3y ago
ChatGPT plugins aren't out of beta yet, but this is 100% going to be eaten by one. Edit: I guess that's not a super productive comment. I commend the authors for building and shipping something useful, I would personally use somet
115.
by killthebuddha 3y ago
Makes sense. I wonder if it would actually make more sense to just plug a function that generates the mask because in general it's just: fn complete(input, masker): completion = input while (not done yet): mask = mask
116.
by killthebuddha 3y ago
I would run postgres with pgvector https://github.com/pgvector/pgvector . I wouldn't call postgres lightweight of course, but it's definitely lightweight in the sense that it doesn't add a whole bunch of
117.
by killthebuddha 3y ago
I imagine it's because there is a *massive* scramble to incorporate language models into existing applications and most of the time you need a vector database to do that. As a proxy for understanding the scale of this scramble, ChatGPT
118.
by killthebuddha 3y ago
In the last 24 hours I've seen a bunch of projects doing LLM -> JSON. I think we want to be focusing on markdown instead. An intuition I have developed is that an ideal prompt has a very clear narrative structure and very tight &quo
119.
by killthebuddha 3y ago
That would almost certainly work to improve reliability but you would probably need something like this anyway, wouldn't you? In general, it seems like building a production-ready LLM-based application requires _a lot_ of these little
120.
by killthebuddha 3y ago
That sounds like a real risk but also the kind of thing you would need to implement a solution for anyways. It seems like there's two clear paths: - Allow the model to complete whatever it wants and then anneal the structure into compl

More ›