3 ms·

It is sound! The real context window is indeed smaller than the advertised marketing number. This gets interesting in verbose languages such as Java, where I've

It is sound! The real context window is indeed smaller than the advertised marketing number. This gets interesting in verbose languages such as Java, where I've seen +16k tokens wasted on the classpath/import stanzas within a class. Yick. The current series of prompts I'm using is somewhat 'manually manage/allocate memory' of the LLM context window. It starts with a PROMPT.md with this content. ``` create or update implementation_status.md with the implementation status study /specs and implement what has not been implemented yet in /src create property-based tests inline in the source file that is being implemented run "make" to verify the implementation after each change ``` If it goes off the rails (and it does) - restart the chat and use this. ``` @prompt continue ``` None of this works without applying /stdlib to control the technical outcomes/patterns to steer the LLM. Otherwise you just get slop.

consumer451 2y ago
> None of this works without applying /stdlib to control the technical outcomes/patterns to steer the LLM. Otherwise you just get slop. The LLM coding tool I have the most experience with is Windsurf IDE + Sonnet 3.5. In Windsurf you can define both global and project rules in .md files. I have found that managing those files very closely is key to success. They just tried to automate that with auto-generated "Memories" but they are generally slop, and I delete them. Managing the project rule file will save you so much pain. That is where I define the frameworks and APIs to use.
- ghuntley 2y ago
  <3 you get it. It's a new skillset to be learned and when it clicks, you get incredible outcomes!
  - consumer451 2y ago
    Getting Supabase MCP running recently was another "oh shit!" moment for me. Prompting to check the schema is great, but prompting against live data in the DB is amazing! For example: > When logged in as user me@domain.com, I can't see the Edit button on src/pages/projects/show.tsx. Please use MCP to check if I have the correct permissions in organization_roles. If I do, look at the UI code to see if we are checking it correctly." Wowzers!

consumer451 2y ago

> None of this works without applying /stdlib to control the technical outcomes/patterns to steer the LLM. Otherwise you just get slop. The LLM coding tool I have the most experience with is Windsurf IDE + Sonnet 3.5. In Windsurf you can define both global and project rules in .md files. I have found that managing those files very closely is key to success. They just tried to automate that with auto-generated "Memories" but they are generally slop, and I delete them. Managing the project rule file will save you so much pain. That is where I define the frameworks and APIs to use.

ghuntley 2y ago
<3 you get it. It's a new skillset to be learned and when it clicks, you get incredible outcomes!
- consumer451 2y ago
  Getting Supabase MCP running recently was another "oh shit!" moment for me. Prompting to check the schema is great, but prompting against live data in the DB is amazing! For example: > When logged in as user me@domain.com, I can't see the Edit button on src/pages/projects/show.tsx. Please use MCP to check if I have the correct permissions in organization_roles. If I do, look at the UI code to see if we are checking it correctly." Wowzers!