When Your Bot Makes Promises You Can't Keep
What is this?
'Policy Hallucination' occurs when an AI chatbot, in an attempt to be helpful and please the customer, invents a policy that doesn't exist. For example, your official policy might say 'Returns within 30 days for unused items,' but your bot might confidently tell a customer, 'No problem! You can return that used item anytime for a full cash refund plus a $10 apology credit.'Why it’s important
This is a massive liability. In many jurisdictions, if a representative of your company (even a digital one) promises a refund or specific term, you may be legally obligated to honor it. Even if you aren't, refusing to honor the bot's promise creates a terrible customer experience, leading to bad reviews and lost trust.How to prevent it (The Fix)
- Use RAG (Retrieval-Augmented Generation): Do not let the AI 'improvise' answers based on its general training. Restrict it to only answer based on your uploaded PDF/URL policy documents.
- Strict System Prompts: Add a directive in your bot's system prompt: 'If the answer is not explicitly found in the knowledge base, state that you need to check with a human. Do not invent policies.'
- Limit Authority: Never give an AI agent the API permission to process a refund or issue store credit autonomously unless it follows a strict, deterministic logic tree (rules-based) rather than generative guessing.
Real-Life Example
An airline's chatbot recently promised a bereavement fare discount that didn't align with the airline's actual web policy. When the customer tried to claim it, the airline refused. The customer sued, and the court ruled that the airline was liable for the chatbot's promise. Don't let your Shopify store be next.
DijiPilot Academy Access Required
This comprehensive masterclass (8.7.5 - Customer Service & Trust Risks (Difficulty: Advanced | Path: Scale)) is locked. Upgrade your plan to unlock the full technical roadmap.
Curriculum: 8.7.5 - Customer Service & Trust Risks (Difficulty: Advanced | Path: Scale)
Loading lesson roadmap for Phase 8.7.5...
Questions & Answers
Reviewing this step? Browse questions from other DijiPilot users below. If you are stuck, check the existing answers to bridge the gap between setup and success.