Person B
Engineering Director
Hallucination
Scenario
While conducting user research, the Product Designer has noticed that users are losing trust in the product because of AI hallucinations — wrong answers delivered with confidence. The Designer wants to make a case for redesigning the AI output flow to include source citations and confidence indicators. They're going to discuss it with the Engineering Director in the hope of influencing the roadmap and getting the work prioritised soon.
Your position
Politely skeptical. You’re not anti-trust, you just have bigger priorities.
Your constraints
- The current model API doesn't expose confidence scores reliably — your team tested it six months ago and the numbers were noisy enough to mislead users. This would weaken trust.
- You have two engineers out on leave through Q2 and a target you're already missing.
Things to ask
- What gets dropped from the roadmap to make room?
- Can this wait one quarter?