4 ms·
The only thing holding this back now is lack of enough context. That’s the big nut to crack. How do you hold enough information in memory at once?
by woeirua 4y ago
The only thing holding this back now is lack of enough context. That’s the big nut to crack. How do you hold enough information in memory at once?
- falcor84 4y agoGPT4 supports 32k tokens, which I guesstimate would be ~25k code tokens and perhaps ~2.5k lines of code. So already enough to work on a whole module of code at the same time. If you're using small microservices, it might already be good enough.
- IanCal 4y agoAlso if you were doing it personally you'd probably not take the whole codebase, but look at function signatures/docs as you get further away from the code you care about. While there's probably benefits in clever systems for summarising and iteratively working on the code, you can get away with just cramming a load of context in. I have been playing with GPT4 and it's good. It's easy to imagine a bunch of use cases where even the maximal cost of a few dollars ($1.80 ish for the context alone) for a single query is worth it. If it's good enough to save you time, it's very easy to cross the threshold where it's cheaper than a person.