5 ms·

Hi. Do you guys have internal degradation tests?

by hu3 9mo ago

awestroke 9mo ago
[flagged]
- dang 9mo ago
  Please don't post shallow dismissals or cross into personal attack in HN discussions. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
  - awestroke 9mo ago
    Got it, won't happen again
stbtrax 9mo ago
I assume so to make sure that they're rendering at 60FPS
- conception 9mo ago
  You joke but having CC open in the terminal hits 10% on my gpu to render the spinning thinking animation for some reason. Switch out of the terminal tab and gpu drops back to zero.
  - gpm 9mo ago
    That sounds like an issue with your terminal more than an issue with CC...
    - Woshiwuja 9mo ago
      [dead]
    - conception 9mo ago
      https://news.ycombinator.com/item?id=46819744 https://news.ycombinator.com/item?id=46819744
      - gpm 9mo ago
        I'm not saying CC doesn't have issues and curious design decisions - but your terminal should only be rendering (at most) a single window of characters every frame no matter what. CC shouldn't be capable of making that take 10% of a modern GPU regardless of what CC does.
        conception 9mo ago
        ¯\_(ツ)_/¯ just vscode plus claude in the terminal on win10.
- reissbaker 9mo ago
  Surely you mean 6fps
  - easygenes 9mo ago
    He doesn't: https://x.com/trq212/status/2014051501786931427 https://x.com/trq212/status/2014051501786931427
    - derrida 9mo ago
      Ah, the hell site, no click.
    - replwoacause 9mo ago
      Don't link out to x, its trash
      - cebert 9mo ago
        Depends on who you follow
    - stavros 9mo ago
      What? Technology has stopped making sense to me. Drawing a UI with React and rasterizing it to ANSI? Are we competing to see what the least appropriate use of React is? Are they really using React to draw a few boxes of text on screen? I'm just flabbergasted.
      - xpe 9mo ago
        There is more than meets the eye for sure. I recently compared a popular TUI library in Go (Bubble Tea) to the most popular Rust library (Ratatui). They use significantly different approaches for rendering. From what I can tell, neither is insane. I haven’t looked to see what Claude Code uses.
      - TZubiri 9mo ago
        It's AI all the way down But it's very subsidizes when compared to API tokens, so we are all being paid by VCs to write prompts actually.
trq_ 9mo ago
Yes, we do but harnesses are hard to eval, people use them across a huge variety of tasks and sometimes different behaviors tradeoff against each other. We have added some evals to catch this one in particular.
- hu3 9mo ago
  Thank you. Fair enough
- amelius 9mo ago
  Can't you keep the model the same, until the user chooses to use a different model?
  - rovr138 9mo ago
    He said it was the harness, not the model though.
bushbaba 9mo ago
I’d wager probably not. It’s not like reliability is what will get them marketshare. And the fast pace of industry makes such foundational tech hard to fund

Hi. Do you guys have internal degradation tests?

by hu3 9mo ago

Hi. Do you guys have internal degradation tests?

awestroke 9mo ago

[flagged]

dang 9mo ago
Please don't post shallow dismissals or cross into personal attack in HN discussions. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- awestroke 9mo ago
  Got it, won't happen again

stbtrax 9mo ago

I assume so to make sure that they're rendering at 60FPS

conception 9mo ago
You joke but having CC open in the terminal hits 10% on my gpu to render the spinning thinking animation for some reason. Switch out of the terminal tab and gpu drops back to zero.
- gpm 9mo ago
  That sounds like an issue with your terminal more than an issue with CC...
  - Woshiwuja 9mo ago
    [dead]
  - conception 9mo ago
    https://news.ycombinator.com/item?id=46819744 https://news.ycombinator.com/item?id=46819744
    - gpm 9mo ago
      I'm not saying CC doesn't have issues and curious design decisions - but your terminal should only be rendering (at most) a single window of characters every frame no matter what. CC shouldn't be capable of making that take 10% of a modern GPU regardless of what CC does.
      - conception 9mo ago
        ¯\_(ツ)_/¯ just vscode plus claude in the terminal on win10.
reissbaker 9mo ago
Surely you mean 6fps
- easygenes 9mo ago
  He doesn't: https://x.com/trq212/status/2014051501786931427 https://x.com/trq212/status/2014051501786931427
  - derrida 9mo ago
    Ah, the hell site, no click.
  - replwoacause 9mo ago
    Don't link out to x, its trash
    - cebert 9mo ago
      Depends on who you follow
  - stavros 9mo ago
    What? Technology has stopped making sense to me. Drawing a UI with React and rasterizing it to ANSI? Are we competing to see what the least appropriate use of React is? Are they really using React to draw a few boxes of text on screen? I'm just flabbergasted.
    - xpe 9mo ago
      There is more than meets the eye for sure. I recently compared a popular TUI library in Go (Bubble Tea) to the most popular Rust library (Ratatui). They use significantly different approaches for rendering. From what I can tell, neither is insane. I haven’t looked to see what Claude Code uses.
    - TZubiri 9mo ago
      It's AI all the way down But it's very subsidizes when compared to API tokens, so we are all being paid by VCs to write prompts actually.

trq_ 9mo ago

Yes, we do but harnesses are hard to eval, people use them across a huge variety of tasks and sometimes different behaviors tradeoff against each other. We have added some evals to catch this one in particular.

hu3 9mo ago
Thank you. Fair enough
amelius 9mo ago
Can't you keep the model the same, until the user chooses to use a different model?
- rovr138 9mo ago
  He said it was the harness, not the model though.

bushbaba 9mo ago

I’d wager probably not. It’s not like reliability is what will get them marketshare. And the fast pace of industry makes such foundational tech hard to fund