3 ms·

This would definitely not work in most bug cases just based on the fact that context size is too short and models too dumb. If you have a "can't access key 'fo

This would definitely not work in most bug cases just based on the fact that context size is too short and models too dumb. If you have a "can't access key 'foo' of undefined" error, adding a check if the object is undefined or not is not a fix. It's simply silencing the error. The bug might be way, way down in the stack, maybe even in the backend or somewhere else in the client that made the backend store invalid data my mistake. I highly doubt that the current breed of models are capable of this.

zachthewf 3y ago
Today the largest context window for GPT-4 is 128k tokens. That's around 300 pages of English text. It's a lot of code! It is certainly not enough for every case, but it is enough (and the models are smart enough) to be useful.
- LunaSea 3y ago
  > Today the largest context window for GPT-4 is 128k tokens. That's around 300 pages of English text. It's a lot of code! It really isn't. I just did a test with a random TypeScript file with 400 lines of code which translates to almost exactly 3000 tokens in the GPT-4 token counter app. This means that we are talking about being capable to analyse a maximum of 43 small / medium sized files. Each analysis will also cost $1.28 without any additional intermediary costs.