ID.me Chatbot Roy

Streamlining Chatbot Experience Through Content Auditing and Optimization

ROLE

Digital Content Creator

TOOLS/METHOD

Miro, Content Writing, Excel

TEAM

Member Experience Team in collaboration with the Chatbot Administration Team

TIMELINE

Aug 2021 - Sep 2021 (1 month)

Background

When visiting the ID.me Help Center, users can choose to chat with Roy, the ID.me chatbot, to resolve their issues. However, users starting a conversation with Roy often abandoned or left the chat before finding a resolution. Users relied on submitting a help ticket rather than continuing to converse with Roy to find an answer.

UNDERSTANDING THE PROBLEM

How can we improve the chatbot experience so that users can resolve their issues with less time and effort?

Objective

The primary objective of this project is to refine the chatbot experience, enabling users to resolve their issues efficiently with minimal time and effort. The team focused on incorporating concise responses, clear calls to action, and definitive resolutions to enhance user engagement, facilitate follow-up actions, and improve overall satisfaction.

Research

To better understand the problem, the team analyzed the current chatbot content and user feedback.

Content Audit

The content audit included assessing the clarity, accuracy, and relevance of responses provided by the chatbot across various user queries and scenarios.  

User Feedback Analysis

The team continuously collected user feedback from direct user inputs, post-interaction surveys, and ratings within the chatbot interface, which was analyzed to identify recurring themes, pain points, and knowledge gaps. Insights drawn from this analysis include adjustments to response strategies, refinement of content, or implementation of new features to address user needs and preferences.

A VALUABLE INSIGHT

As a result, the team found that there was an average abandonment rate of 60-70%. 

Process

Content Rewriting and Optimization

Based on the findings of the content audit, the platform undertakes a content rewriting and optimization process. This involves refining the language, structure, and tone of the chatbot responses to ensure clarity and coherence. Additionally, technical terminology is simplified, and complex concepts are explained in a more accessible manner.

Removing Non-Value-Added Interactions

Non-value-added interactions, such as redundant queries or irrelevant responses, are identified and eliminated from the chatbot's content map. By streamlining the interaction flow, users can navigate the chatbot more efficiently, reducing the time spent on resolving their issues.

Content Mapping

A content mapping strategy is implemented to align the chatbot responses with the specific needs and preferences of users. This involves categorizing and organizing the chatbot content based on topic areas, user personas, and common queries, enabling more targeted and relevant assistance.

Continuous Monitoring and Iteration

The team established a process for continuous monitoring and iteration of the chatbot performance. User feedback, interaction logs, and data are analyzed to identify further areas for optimization and refinement. Regular updates and improvements are made to ensure that the chatbot remains responsive and effective in addressing user queries.

Results

MAJOR WIN

The average abandonment rate decreased from 60-70% to 15-25% within the first 6-8 weeks of implementation.

Reflection

This project was incredibly fulfilling, and I've found that my role in maintaining the ID.me knowledge base played a significant part in the success of the chatbot project. This knowledge directly informed the development and optimization of the chatbot, allowing us to tailor its responses to better address user inquiries.

Additionally, my experience in maintaining the knowledge base instilled a disciplined approach to content management, which proved invaluable in keeping the chatbot's responses up-to-date and comprehensive. Moving forward, I'm excited to continue leveraging my expertise in knowledge management to further enhance the effectiveness and usability of our chatbot, always with the users' needs at the forefront.

KEY TAKEAWAY

Providing actionable guidance and closure not only improves user engagement and satisfaction but also facilitates smoother navigation and follow-up actions, ultimately contributing to a more seamless and fulfilling user experience.