4 ms·

Out of interest, has anyone ever integrated with Grok? I've done so many LLM integrations in the last few years, but never heard of anyone choosing Grok. I feel

Out of interest, has anyone ever integrated with Grok? I've done so many LLM integrations in the last few years, but never heard of anyone choosing Grok. I feel like they are going to need an unmistakably capable model before anyone would want to risk it - they don't behave like a serious company.

Gigachad 1y ago
[flagged]
- wongarsu 1y ago
  There have been at least two instances of "unauthorized modifications" to the system prompt of the Grok model running wild in X, but if you build your own integration you would provide your own system prompt and be unaffected by that. On the model side I've found Grok3 to be very unbiased. If you ask it to write a story it will somehow find a way to weave a mention of X/Twitter into that story, but other than that it is much less biased and moralizing than e.g. OpenAI models. It also has very lax guard rails, so that's something you'd probably want to add I can't say yet whether all of this is still true for Grok 4
  - hhh 1y ago
    Are you asking it to write a story on like grok.com or inside of twitter, or are you saying that if I call the API and ask for a story I'm going to get twitter weaved in there somehow
    - wongarsu 1y ago
      Both on the API (which I'm using for openwebui) and on grok.com. It might just be that twitter is a disproportionate amount of their training data, leading grok to believe in a world where twitter is much more ubiquitous than in our current reality. And the grok.com version might be unintentionally biased because it has a tool to search twitter and the system prompt instructs it on how to use it, leading to a sentence about X to always be in the prompt in that version. I'm not at all claiming that it has to be an intentional plot to promote twitter, it might just be an accident. But it is a very perceivable bias
  - ceejayoz 1y ago
    > if you build your own integration you would provide your own system prompt… That won't save you if the model itself is trained on some nasty shit.
47thpresident 1y ago
Grok 3 is on Azure AI Foundary [0] and announced an integration with Telegram, albeit they are paying Telegram $300m not vice versa [1]. But I agree, choosing Grok is just a huge reputational liability for anyone’s work that is serious. [0] https://devblogs.microsoft.com/foundry/announcing-grok-3-and-grok-3-mini-on-azure-ai-foundry/ https://devblogs.microsoft.com/foundry/announcing-grok-3-and... [1] https://www.bbc.co.uk/news/articles/cdxvr3n7wlxo https://www.bbc.co.uk/news/articles/cdxvr3n7wlxo
- thebigspacefuck 1y ago
  Any plans for GCP Vertex AI or AWS Bedrock? Apparently Grok 3 had the highest score for Golang on roocode.com/evals so I’d like to try it for coding. The free tier app hasn’t been bad either, I like it’s attitude a bit better than ChatGPT.
hersko 1y ago
You would have to be insane to integrate the model that last week called itself "Mecha Hitler" into your live product. As a huge Musk fan i'll be the first to point out how he's doing exactly what he accused Sama of doing; making powerful ai with an obvious lack of control or effective alignment.
sergiotapia 1y ago
I am using Grok to visually analyze food images. Works really well, recognizes brands and weird shots users send me. API really easy to use.
Workaccount2 1y ago
I'm more curious where Grok gets talent from. There is so much money and so many top labs falling over themselves to attract good talent, that at this point people have to be leaning on ideological goals to choose their employer. Are there really that many AI researchers who want to make Elon god-emperor?
- brcmthrowaway 1y ago
  He must be paying them millions
- qoez 1y ago
  I read the last election and other signals as the idea that there's way more unspoken diversity of thought in peoples minds than what people feel safe to say. Secretly lots of top talent probably doesn't care or even aligns with elon but chooses to say so at most with their actions in the form of being ok working for him.
  - knowsuchagency 1y ago
    Diversity of thought is a nice way to put it
- nashadelic 1y ago
  I also feel Elon's team has been "untouchable" for Zuck and doesn't want to stir anything with him. But since his falling out of grace with the admin that could change?
- dotnet00 1y ago
  If you're focusing on ideology, it isn't like the other companies are all that good. With Sam Altman you're still working for a pathological liar with delusions of grandeur. With Google and Meta you're propping up a massive worldwide surveillance apparatus. Tech-bros have been propping up agents/propagators of some of the biggest social ills of the past ~2 decades, xAI isn't all that different.
- hbn 1y ago
  A lot of serious engineers would love to work in an environment that isn't the HR-reigning office politics bullshit standard of the past decade or two. I don't even really like Elon but I bet the engineers at X are having a better time in their day-to-day than the ones at Meta or Google where all their work is constantly roadblocked by red tape, in-fighting, and PMs whose only goal is to make it look like they headed something important to get themselves promoted. Elon's at least got a vision and keeps it a top priority to be competitive in the AI space.

Gigachad 1y ago

[flagged]

wongarsu 1y ago
There have been at least two instances of "unauthorized modifications" to the system prompt of the Grok model running wild in X, but if you build your own integration you would provide your own system prompt and be unaffected by that. On the model side I've found Grok3 to be very unbiased. If you ask it to write a story it will somehow find a way to weave a mention of X/Twitter into that story, but other than that it is much less biased and moralizing than e.g. OpenAI models. It also has very lax guard rails, so that's something you'd probably want to add I can't say yet whether all of this is still true for Grok 4
- hhh 1y ago
  Are you asking it to write a story on like grok.com or inside of twitter, or are you saying that if I call the API and ask for a story I'm going to get twitter weaved in there somehow
  - wongarsu 1y ago
    Both on the API (which I'm using for openwebui) and on grok.com. It might just be that twitter is a disproportionate amount of their training data, leading grok to believe in a world where twitter is much more ubiquitous than in our current reality. And the grok.com version might be unintentionally biased because it has a tool to search twitter and the system prompt instructs it on how to use it, leading to a sentence about X to always be in the prompt in that version. I'm not at all claiming that it has to be an intentional plot to promote twitter, it might just be an accident. But it is a very perceivable bias
- ceejayoz 1y ago
  > if you build your own integration you would provide your own system prompt… That won't save you if the model itself is trained on some nasty shit.

47thpresident 1y ago

Grok 3 is on Azure AI Foundary [0] and announced an integration with Telegram, albeit they are paying Telegram $300m not vice versa [1]. But I agree, choosing Grok is just a huge reputational liability for anyone’s work that is serious. [0] https://devblogs.microsoft.com/foundry/announcing-grok-3-and-grok-3-mini-on-azure-ai-foundry/ https://devblogs.microsoft.com/foundry/announcing-grok-3-and... [1] https://www.bbc.co.uk/news/articles/cdxvr3n7wlxo https://www.bbc.co.uk/news/articles/cdxvr3n7wlxo

thebigspacefuck 1y ago
Any plans for GCP Vertex AI or AWS Bedrock? Apparently Grok 3 had the highest score for Golang on roocode.com/evals so I’d like to try it for coding. The free tier app hasn’t been bad either, I like it’s attitude a bit better than ChatGPT.

hersko 1y ago

You would have to be insane to integrate the model that last week called itself "Mecha Hitler" into your live product. As a huge Musk fan i'll be the first to point out how he's doing exactly what he accused Sama of doing; making powerful ai with an obvious lack of control or effective alignment.

sergiotapia 1y ago

I am using Grok to visually analyze food images. Works really well, recognizes brands and weird shots users send me. API really easy to use.

Workaccount2 1y ago

I'm more curious where Grok gets talent from. There is so much money and so many top labs falling over themselves to attract good talent, that at this point people have to be leaning on ideological goals to choose their employer. Are there really that many AI researchers who want to make Elon god-emperor?

brcmthrowaway 1y ago
He must be paying them millions
qoez 1y ago
I read the last election and other signals as the idea that there's way more unspoken diversity of thought in peoples minds than what people feel safe to say. Secretly lots of top talent probably doesn't care or even aligns with elon but chooses to say so at most with their actions in the form of being ok working for him.
- knowsuchagency 1y ago
  Diversity of thought is a nice way to put it
nashadelic 1y ago
I also feel Elon's team has been "untouchable" for Zuck and doesn't want to stir anything with him. But since his falling out of grace with the admin that could change?
dotnet00 1y ago
If you're focusing on ideology, it isn't like the other companies are all that good. With Sam Altman you're still working for a pathological liar with delusions of grandeur. With Google and Meta you're propping up a massive worldwide surveillance apparatus. Tech-bros have been propping up agents/propagators of some of the biggest social ills of the past ~2 decades, xAI isn't all that different.
hbn 1y ago
A lot of serious engineers would love to work in an environment that isn't the HR-reigning office politics bullshit standard of the past decade or two. I don't even really like Elon but I bet the engineers at X are having a better time in their day-to-day than the ones at Meta or Google where all their work is constantly roadblocked by red tape, in-fighting, and PMs whose only goal is to make it look like they headed something important to get themselves promoted. Elon's at least got a vision and keeps it a top priority to be competitive in the AI space.