5 ms·

Weird, I've been told you can just throw AI at all your logs and metrics and it can magically solve all the things...

by unknownfuture 2mo ago

akkad33 2mo ago
Maybe they are dedicated hand coders!
- q4wsh 2mo ago
  They were before 2023, when things worked ... So a "component" failed? That sounds like a software component. We just saw in https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug how sloppy bot coding is.
rurban 2mo ago
My blackest Monday today. Deepseek is off/too expensive, Claude tokens out for 3 days, kimi refuses, and Github down for the whole afternoon. Maybe I'll take the week off
- ALLTaken 2mo ago
  hmm very interesting combination of services being down. I've been using DeepSeek v4 Pro and Qwen3.8 now daily for close to 2 weeks. Damn good and reliable. Anytime I need to verify math I check with Kimi k3 tho, it still feels like being superior to these both, not sure if actually true.
- ajmurmann 2mo ago
  It's crazy that it wasn't that long ago that all we worked with was a compiler on the local machine and maybe a SVN server you'd interact with every few hours
  - intrasight 2mo ago
    Not that long ago that I used a local CVS server for SCCS. OK, almost 40 years - but still.
    - sillysaurusx 2mo ago
      CVS was alive and well as of 16 years ago. It was our primary source control system at S2 Games. I was shocked but it really wasn’t all that bad.
      - eterm 2mo ago
        Disadvantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Advantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Sometimes, not being able to work independently can be an advantage. Two people discovering they're trying to work on the same file can lead to useful conversations.
      - irishcoffee 2mo ago
        Oh wow did you work on HoN? I devoted many, many, many hours to that game.
        sillysaurusx 1mo ago
        Sure did :) it was one of the few times when I worked on a product I truly loved. https://github.com/shawwn/noh https://github.com/shawwn/noh
        irishcoffee 1mo ago
        That is so cool. I bet that was an absolute blast. Can I ask for a war story? Something hard or goofy that I as I player (and a software engineer) probably had no idea you had to solve? I really loved that game.
        sillysaurusx 1mo ago
- rambojohnson 2mo ago
  [dead]
- timcobb 2mo ago
  Nvidia build might have DeepSeek capacity
hombre_fatal 2mo ago
Well, it would be a mistake on your part to assume that everything in an organization, especially a large one like github, is a reflection of the capabilities of the state of the art in anything (AI, architecture, programming language, organizational management, operations, etc.). It's clear that updating the status page as quickly as possible isn't even something github cares about.
- esseph 2mo ago
  > It's clear that updating the status page as quickly as possible isn't even something github cares about. Status pages for large companies are social, political and legal tools, and not technical indicators. It has always been this way, and likely always will unless some laws were passed.
  - bethekidyouwant 2mo ago
    Laws? (Is the first one you must have a status page?)
    - esseph 2mo ago
      Yes, laws, regulations. They're fucking useful tools of curbing shitty but not yet illegal behavior that is at BEST a dishonest attempt to avoid contractual accountability. Yes, a fucking law. Maybe a whole set of them!
- unknownfuture 2mo ago
  It would be a mistake to judge AI based on the performance of one of its strongest pushers and promoters? Interesting take.
  - therealdrag0 2mo ago
    My company is heavy on AI promotion, but many many many people still do things sub-optimally, and many systems are still not well integrated/able with AI. “The future is here it’s just not evenly distributed”, and that applies inside companies too. Hard to actually judge without being in the room and knowing the team that owns the incident. And as other said, it’s pretty common IME to have a root cause but slow roll communication of it until remediation has more confidence.

Weird, I've been told you can just throw AI at all your logs and metrics and it can magically solve all the things...

akkad33 2mo ago

Maybe they are dedicated hand coders!

q4wsh 2mo ago
They were before 2023, when things worked ... So a "component" failed? That sounds like a software component. We just saw in https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug how sloppy bot coding is.

rurban 2mo ago

My blackest Monday today. Deepseek is off/too expensive, Claude tokens out for 3 days, kimi refuses, and Github down for the whole afternoon. Maybe I'll take the week off

ALLTaken 2mo ago
hmm very interesting combination of services being down. I've been using DeepSeek v4 Pro and Qwen3.8 now daily for close to 2 weeks. Damn good and reliable. Anytime I need to verify math I check with Kimi k3 tho, it still feels like being superior to these both, not sure if actually true.
ajmurmann 2mo ago
It's crazy that it wasn't that long ago that all we worked with was a compiler on the local machine and maybe a SVN server you'd interact with every few hours
- intrasight 2mo ago
  Not that long ago that I used a local CVS server for SCCS. OK, almost 40 years - but still.
  - sillysaurusx 2mo ago
    CVS was alive and well as of 16 years ago. It was our primary source control system at S2 Games. I was shocked but it really wasn’t all that bad.
    - eterm 2mo ago
      Disadvantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Advantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Sometimes, not being able to work independently can be an advantage. Two people discovering they're trying to work on the same file can lead to useful conversations.
    - irishcoffee 2mo ago
      Oh wow did you work on HoN? I devoted many, many, many hours to that game.
      - sillysaurusx 1mo ago
        Sure did :) it was one of the few times when I worked on a product I truly loved. https://github.com/shawwn/noh https://github.com/shawwn/noh
        irishcoffee 1mo ago
        That is so cool. I bet that was an absolute blast. Can I ask for a war story? Something hard or goofy that I as I player (and a software engineer) probably had no idea you had to solve? I really loved that game.
        sillysaurusx 1mo ago
rambojohnson 2mo ago
[dead]
timcobb 2mo ago
Nvidia build might have DeepSeek capacity

hombre_fatal 2mo ago

Well, it would be a mistake on your part to assume that everything in an organization, especially a large one like github, is a reflection of the capabilities of the state of the art in anything (AI, architecture, programming language, organizational management, operations, etc.). It's clear that updating the status page as quickly as possible isn't even something github cares about.

esseph 2mo ago
> It's clear that updating the status page as quickly as possible isn't even something github cares about. Status pages for large companies are social, political and legal tools, and not technical indicators. It has always been this way, and likely always will unless some laws were passed.
- bethekidyouwant 2mo ago
  Laws? (Is the first one you must have a status page?)
  - esseph 2mo ago
    Yes, laws, regulations. They're fucking useful tools of curbing shitty but not yet illegal behavior that is at BEST a dishonest attempt to avoid contractual accountability. Yes, a fucking law. Maybe a whole set of them!
unknownfuture 2mo ago
It would be a mistake to judge AI based on the performance of one of its strongest pushers and promoters? Interesting take.
- therealdrag0 2mo ago
  My company is heavy on AI promotion, but many many many people still do things sub-optimally, and many systems are still not well integrated/able with AI. “The future is here it’s just not evenly distributed”, and that applies inside companies too. Hard to actually judge without being in the room and knowing the team that owns the incident. And as other said, it’s pretty common IME to have a root cause but slow roll communication of it until remediation has more confidence.