| description |
|---|
Before you dive right in, here's a few things to think about |
Identify your use case and value hypothesis. Where do you believe an AI bot may be useful? To which customers or people?
How will you measure the bot's value? Usually, that is:
- # of messages sent
- D1, D3, D7, D30 Retention of users
- Positive vs negative feedback from users
- % of questions asked by the user that were answered by the bot
Curate the knowledge base dataset e.g. documents, videos, PDFs, websites, and soon real-time data sources.
Create "Golden" Questions and Answers
Let’s assume a human expert understood all of the documents in the above knowledge base dataset and then one of your users asked the human expert a question; what ideal answer would you expect the human expert to provide? This is the Golden Answer.
- Collect 10 questions and the ideal Golden Answer for each
- The question should be captured in whatever form we believe the user is likely to ask it - e.g. in Bhojpuri as a WhatsApp audio note, mixed-Hinglish text, English text, and/or Tamil text.
- If non-English, provide the English text translation of the question
- The ideal “golden” answer in English text
- Collect the above as rows in the Excel or Google sheet.