3 ms·

> every AI coding bot will learn your new language If there are millions of lines on github in your language. Otherwise the 'teaching AI to write your languag

> every AI coding bot will learn your new language If there are millions of lines on github in your language. Otherwise the 'teaching AI to write your language' part will occupy so much context and make it far less efficient that just using typescript.

calvinmorrison 8mo ago
Uh not really. I am already having Claude read and then one-shot proprietary ERP code written in vintage closed source language OOP oriented BASIC with sparse documentation.... just needed to feed it in the millions of lines of code i have and it works.
- vrighter 8mo ago
  "i haven't been able to find much" != "there isn't much on the entire internet fed into them"
- jonfw 8mo ago
  I'm sure claude does great at that, but it would be objectively better, for a large variety of reasons, if claude didn't have to keep syntax examples in it's context.
  - calvinmorrison 8mo ago
    for sure. About 6 months ago it absolutely couldn't do it and kept getting cofnused even when i tried to do RAG against the manuals provided (only downloadable from a shady .ru site LOL) but now .. like butter. The context seems to mostly be it reading and writing related stuff?
Maxatar 8mo ago
I have not found this to be the case. My company has some proprietary DSLs we use and we can provide the spec of the language with examples and it manages to pick up on it and use it in a very idiomatic manner. The total context needed is 41k tokens. That's not trivial but it's also not that much, especially with ChatGPT Codex and Gemini now providing context lengths of 1 million tokens. Claude Code is very likely to soon offer 1 million tokens as well and by this time next year I wouldn't be surprised if we reach context windows 2-4x that amount. The vast majority of tokens are not used for documentation or reference material but rather are for reasoning/thinking. Unless you somehow design a programming language that is just so drastically different than anything that currently exists, you can safely bet that LLMs will pick them up with relative ease.
- joshstrange 8mo ago
  > Claude Code is very likely to soon offer 1 million tokens as well You can do it today if you are willing to pay (API or on top of your subscription) [0] > The 1M context window is currently in beta. Features, pricing, and availability may change. > Extended context is available for: > API and pay-as-you-go users: full access to 1M context > Pro, Max, Teams, and Enterprise subscribers: available with extra usage enabled > Selecting a 1M model does not immediately change billing. Your session uses standard rates until it exceeds 200K tokens of context. Beyond 200K tokens, requests are charged at long-context pricing with dedicated rate limits. For subscribers, tokens beyond 200K are billed as extra usage rather than through the subscription. [0] https://code.claude.com/docs/en/model-config#extended-context https://code.claude.com/docs/en/model-config#extended-contex...
rebolek 8mo ago
That’s not true. I’m working on a language and LLMs have no problems writing code in it even if there exists ~200 lines of code in the language and all of them are in my repo.

calvinmorrison 8mo ago

Uh not really. I am already having Claude read and then one-shot proprietary ERP code written in vintage closed source language OOP oriented BASIC with sparse documentation.... just needed to feed it in the millions of lines of code i have and it works.

vrighter 8mo ago
"i haven't been able to find much" != "there isn't much on the entire internet fed into them"
jonfw 8mo ago
I'm sure claude does great at that, but it would be objectively better, for a large variety of reasons, if claude didn't have to keep syntax examples in it's context.
- calvinmorrison 8mo ago
  for sure. About 6 months ago it absolutely couldn't do it and kept getting cofnused even when i tried to do RAG against the manuals provided (only downloadable from a shady .ru site LOL) but now .. like butter. The context seems to mostly be it reading and writing related stuff?

Maxatar 8mo ago

I have not found this to be the case. My company has some proprietary DSLs we use and we can provide the spec of the language with examples and it manages to pick up on it and use it in a very idiomatic manner. The total context needed is 41k tokens. That's not trivial but it's also not that much, especially with ChatGPT Codex and Gemini now providing context lengths of 1 million tokens. Claude Code is very likely to soon offer 1 million tokens as well and by this time next year I wouldn't be surprised if we reach context windows 2-4x that amount. The vast majority of tokens are not used for documentation or reference material but rather are for reasoning/thinking. Unless you somehow design a programming language that is just so drastically different than anything that currently exists, you can safely bet that LLMs will pick them up with relative ease.

joshstrange 8mo ago
> Claude Code is very likely to soon offer 1 million tokens as well You can do it today if you are willing to pay (API or on top of your subscription) [0] > The 1M context window is currently in beta. Features, pricing, and availability may change. > Extended context is available for: > API and pay-as-you-go users: full access to 1M context > Pro, Max, Teams, and Enterprise subscribers: available with extra usage enabled > Selecting a 1M model does not immediately change billing. Your session uses standard rates until it exceeds 200K tokens of context. Beyond 200K tokens, requests are charged at long-context pricing with dedicated rate limits. For subscribers, tokens beyond 200K are billed as extra usage rather than through the subscription. [0] https://code.claude.com/docs/en/model-config#extended-context https://code.claude.com/docs/en/model-config#extended-contex...

rebolek 8mo ago

That’s not true. I’m working on a language and LLMs have no problems writing code in it even if there exists ~200 lines of code in the language and all of them are in my repo.