I've effectively become the "AI expert" on my team, but I still hold my same title (Sr SWE). Being very familiar with Bedrock and its related APIs, in particul

I've effectively become the "AI expert" on my team, but I still hold my same title (Sr SWE). Being very familiar with Bedrock and its related APIs, in particular: - running accuracy and related metrics - building RAG solutions using Knowledge Bases, separating in the response and in the flows what is and what isn't AI-generated - adding Bedrock Guardrails to catch the "bad stuff" and using Bedrock Reranker to improve accuracy A giant portion of the job is just asking "What do you want?" over and over again. And also just asking "What do you want to happen when it cannot answer?" Gathering (or building) ground truth data to be able to do Accuracy evaluations. Also doing a lot of mitigation around the limitations of the tools: adding rate-limiters, resilience4j kind of stuff.