4 ms·
Tell HN: Atlassian Intelligence "hallucinated" a runbook during an incident
Today I had a pretty bizarre experience with a new feature in Confluence: when you search the wiki you may now get a big widget at the top of the results with some LLM generated text, similar to what Bing and Quora does nowadays.
In my case I was searching for a specific runbook with a bunch of aws and k8s commands, so this AI suggested a mix of several wiki pages and it wasn't completely wrong but the answer did include for instance a wrong environment variable, "AWS_ENV", instead of "AWS_PROFILE", to specify the deployment environment...
It looks like this functionality is automatically triggered when your search query looks like a question, unfortunately that's also common for runbook titles.
- 1oooqooq 3y agomy employer, a huge attlassian client, does use AWS_ENV extensively :ponderingface edit: guess i can still remain anonymous if i say it's a combination of aws profile, region and environment into one value.