4 ms·

I understand where you're coming from, let me clarify. I'm surprised at the perseverance of HN users with our game, not nefarious actors in real world. I'm not

I understand where you're coming from, let me clarify. I'm surprised at the perseverance of HN users with our game, not nefarious actors in real world. I'm not a leading expert in penetration attacks, but I get the seriousness of handling sensitive data. There are many things we did with this game that I would never advise anyone do, like put sensitive information in a system prompt and make it available to the open internet. The goal of this game was to show conceptually how Maitai helps a model adhere to it's expectations.

bofadeez 2y ago
> I would never advise anyone do, like put sensitive information in a system prompt and make it available to the open internet So your product can never assist with a company chatbot / AI support rep who needs access to customer data or internal company info? What's the point of your product if you don't facilitate sensitive data in system prompts?
- cmdalsanto 2y ago
  Maitai helps LLMs adhere to the expectations given to them. With that said, there are multiple layers to consider when dealing with sensitive data with chatbots, right? First off, you'd probably want to make sure you authenticate the individual on the other end of the convo, then compartmentalize what data the LLM has access to for only that authenticated user. Maitai would be just 1 part of a comprehensive solution.
  - mistermann 2y ago
    You should reconceptualize your company as a llm proxy platform, that does many things, and then it also sells these other optional services: {the things above...and then this way you can put a nice big BETA label on the portion you are getting your ass kicked in the comments for lol} Your strategic position in the stack is the value here imho. And I really like the idea of having a way to run pre and post quality and comparison processing. What other services could you offer in your portal?
    - Carrok 2y ago
      This is one of the funniest fails in HN history. Making me feel slightly better about myself. Absolutely priceless material. This will go down in the annals alongside such epics as “just use rysnc”.
      - bofadeez 2y ago
        Relax, pivoting isn't the end of the world
        Carrok 2y ago
        I wasn't referring to a pivot, but to their secret phrase being cracked almost immediately.
      - mistermann 2y ago
        Perceiving oneself to have knowledge of the future is also classic HN foolishness so I wouldn't get too cocky.
    - bofadeez 2y ago
      Sounds like https://github.com/BerriAI/litellm https://github.com/BerriAI/litellm
oefrha 2y ago
Sorry this is a terrible response. Your entire sales pitch is “never” violating “mission-critical expectations”, and now that your demo broke down after a mere ~2000 attempts within a few hours, you tell us we shouldn’t have mission critical expectations in the first place. So why the hell should people use your product, with lofty claims of strong defense backed up by “not a leading expert in penetration attacks”? Your “helps a model adhere to its expectations” is like changing a five character password to six characters in a traditional setting, yeah it helps a bit, but it’s still woefully insufficient, and not worth paying a lot of money for.

bofadeez 2y ago

> I would never advise anyone do, like put sensitive information in a system prompt and make it available to the open internet So your product can never assist with a company chatbot / AI support rep who needs access to customer data or internal company info? What's the point of your product if you don't facilitate sensitive data in system prompts?

cmdalsanto 2y ago
Maitai helps LLMs adhere to the expectations given to them. With that said, there are multiple layers to consider when dealing with sensitive data with chatbots, right? First off, you'd probably want to make sure you authenticate the individual on the other end of the convo, then compartmentalize what data the LLM has access to for only that authenticated user. Maitai would be just 1 part of a comprehensive solution.
- mistermann 2y ago
  You should reconceptualize your company as a llm proxy platform, that does many things, and then it also sells these other optional services: {the things above...and then this way you can put a nice big BETA label on the portion you are getting your ass kicked in the comments for lol} Your strategic position in the stack is the value here imho. And I really like the idea of having a way to run pre and post quality and comparison processing. What other services could you offer in your portal?
  - Carrok 2y ago
    This is one of the funniest fails in HN history. Making me feel slightly better about myself. Absolutely priceless material. This will go down in the annals alongside such epics as “just use rysnc”.
    - bofadeez 2y ago
      Relax, pivoting isn't the end of the world
      - Carrok 2y ago
        I wasn't referring to a pivot, but to their secret phrase being cracked almost immediately.
    - mistermann 2y ago
      Perceiving oneself to have knowledge of the future is also classic HN foolishness so I wouldn't get too cocky.
  - bofadeez 2y ago
    Sounds like https://github.com/BerriAI/litellm https://github.com/BerriAI/litellm

oefrha 2y ago

Sorry this is a terrible response. Your entire sales pitch is “never” violating “mission-critical expectations”, and now that your demo broke down after a mere ~2000 attempts within a few hours, you tell us we shouldn’t have mission critical expectations in the first place. So why the hell should people use your product, with lofty claims of strong defense backed up by “not a leading expert in penetration attacks”? Your “helps a model adhere to its expectations” is like changing a five character password to six characters in a traditional setting, yeah it helps a bit, but it’s still woefully insufficient, and not worth paying a lot of money for.