4 ms·

the headline hints that there's some sort of non-obvious factor that's going to be revealled. I scrolled past countless redundant and information-sparse graph-l

by skeeter2020 6mo ago

the headline hints that there's some sort of non-obvious factor that's going to be revealled. I scrolled past countless redundant and information-sparse graph-like figures and never found it; moved on. If you've only got a paragraph worth of information to share, say it and let us get on with our lives.

chambertime 6mo ago
Well I couldn't find any other thorough dataset on this topic, so in that sense this is non-obvious since it took weeks to assemble the information. And it was fun doing it using the LLM Wiki technique.
- JumpCrisscross 6mo ago
  > it was fun doing it using the LLM Wiki technique What is that?
  - chambertime 6mo ago
    https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f https://gist.github.com/karpathy/442a6bf555914893e9891c11519...
    - JumpCrisscross 6mo ago
      Could you share the tools you used to do this? I'd love to organise my esoteric research side quests like this.
      - chambertime 6mo ago
        Git + claude code in yolo mode. In the first prompt, I passed it Kaparthy's gist, and had it put together a high level plan of all of the sections that needed to be written to complete a vision I provided. Essentially put together a complete wiki on everything for getting global hardware certification. I then had it loop once an hour. It would pick the next wiki to write, research it, gather raw sources, and then synthesize the wiki for me and push. I could nudge it in between hours if I wanted.
        JumpCrisscross 6mo ago
        Do you add this as a skill or permanent prompt, making it always maintain wikis in the background? Or do you direct it to make these only when you're in the project?
        chambertime 6mo ago
        There's skills if you want. I didn't want to do that since I don't feel like I need the smarts to work on the LLM wiki in every coding session. I like to keep my context clean and scoped to what I'm working on. I am running this in a long running session that spawns a subagent once an hour. So the context of the main session doesn't get out of control.
  - rnxrx 6mo ago
    The general idea is to have the LLM maintain longer-term context/background by storing it in a format/structure that's akin to a standard Wiki. The result is (hopefully) a series of human-readable and editable documents that's developed and maintained by the agent. There's great coverage of it at https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f https://gist.github.com/karpathy/442a6bf555914893e9891c11519... It's actually also now a base capability in the Hermes agent and has been really helpful for me, at least.

chambertime 6mo ago

Well I couldn't find any other thorough dataset on this topic, so in that sense this is non-obvious since it took weeks to assemble the information. And it was fun doing it using the LLM Wiki technique.

JumpCrisscross 6mo ago
> it was fun doing it using the LLM Wiki technique What is that?
- chambertime 6mo ago
  https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f https://gist.github.com/karpathy/442a6bf555914893e9891c11519...
  - JumpCrisscross 6mo ago
    Could you share the tools you used to do this? I'd love to organise my esoteric research side quests like this.
    - chambertime 6mo ago
      Git + claude code in yolo mode. In the first prompt, I passed it Kaparthy's gist, and had it put together a high level plan of all of the sections that needed to be written to complete a vision I provided. Essentially put together a complete wiki on everything for getting global hardware certification. I then had it loop once an hour. It would pick the next wiki to write, research it, gather raw sources, and then synthesize the wiki for me and push. I could nudge it in between hours if I wanted.
      - JumpCrisscross 6mo ago
        Do you add this as a skill or permanent prompt, making it always maintain wikis in the background? Or do you direct it to make these only when you're in the project?
        chambertime 6mo ago
        There's skills if you want. I didn't want to do that since I don't feel like I need the smarts to work on the LLM wiki in every coding session. I like to keep my context clean and scoped to what I'm working on. I am running this in a long running session that spawns a subagent once an hour. So the context of the main session doesn't get out of control.
- rnxrx 6mo ago
  The general idea is to have the LLM maintain longer-term context/background by storing it in a format/structure that's akin to a standard Wiki. The result is (hopefully) a series of human-readable and editable documents that's developed and maintained by the agent. There's great coverage of it at https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f https://gist.github.com/karpathy/442a6bf555914893e9891c11519... It's actually also now a base capability in the Hermes agent and has been really helpful for me, at least.