Skip to main content

How do I set up Automated Categorization (Topic classification) with generative AI?

Updated over 6 months ago

Introduction

Ender Turing's AI-powered quality evaluation tool is designed to help businesses automate and streamline the quality assurance process for contact center conversations (calls, chats, support tickets, etc).

By leveraging Generative AI, Ender Turing offers a scalable solution that automatically detects topics for post-conversation analytics and helps identify and categorize the key issues or themes discussed during customer interactions. This allows contact centers to gain insights into common problems, identify trends and products, and optimize agent training and business processes.

Generative AI for conversation analytics involves leveraging LLMs (Large Language Models) to analyze and assess customer-agent interactions. The AI leverages AI models to automatically generate and categorize topics based on the call's content. The AI identifies and categorizes key themes without predefined rules, adapting to new topics over time. It’s highly flexible and works well in dynamic environments where new trends emerge frequently. Generative categorization is a fast and efficient way to categorize new or evolving topics but can't be used to categorize through historical conversation.

This guide will walk you through how to maximize Ender Turing's Automated Categorisation for your business.

Key Benefits of Automated Topic Categorization

  • Automation: Say goodbye to manual conversation categorization with a fully automated solution.

  • Actionable Insights: It provides valuable data on customer interactions, helping businesses identify common pain points, trends, and areas for improvement, which can guide strategic decision-making. Understand why your customers call or write to you, why sales proposals are rejected, why marketing campaigns fail, and more.

  • Customizable: Tailor the evaluation criteria to fit your business needs and goals.

  • Scalability: Conversation categorization enables businesses to manage large volumes of interactions efficiently, allowing for consistent service quality as they scale.

  • Enhanced Customer Experience: By quickly identifying and addressing recurring issues, businesses can offer a more personalized and responsive customer experience.

Concept

Using a generative AI model for conversation categorization begins by anonymizing the customer-agent interactions to remove personal data, ensuring compliance with privacy regulations. The anonymized conversation is then sent to the AI with a predefined list of Categories (Topics). The AI processes the conversation and suggests the closest matched categories for each conversation. Managers and other teams (marketing, product) then review these results to help refine the performance and decision-making of their operations.

Step-by-Step Guide

To use AutoQA in Ender Turing, you need to create:

  1. List of Categories (Topics)

  2. Created Categories

  3. and Ender with rules on which conversations to categorize (and which Categories to use).

1. Categories list compilation

Organizations already have a topic.

In most cases, your organization already has categories (topics) from previous manual categorization processes made by Agents after the conversation. You can use these topics.

! Important - If you have more than 50 topics, please use any generative chat tool (ChatGPT, Anthropic, Gemini, etc.) to reduce the number of topics to 50. Using more than 50 topics to categorize a single conversation may lead to picking up a very close but incorrect topic. Make sure Topics are different enough and do not overlap in meaning.

The organization does not have a topic.

Please use any generative chat tool (ChatGPT, Anthropic, Gemini, etc.) to create such a list using prompts like:

Suggest 50 key topics for categorizing customer inquiries and issues in a [organization type]. These topics should cover a wide range of common interactions such as product/service inquiries, account management, billing, technical support, fraud detection, customer support, regulatory compliance, transaction issues, and other areas relevant to the business.

Or more specifically, for example, for a financial company:

Suggest 50 key topics for categorizing customer inquiries and issues in a financial organization. These topics should cover a wide range of common interactions such as account management, loans, credit cards, fraud detection, mortgage services, investment options, online banking, customer support, regulatory compliance, transaction issues, and other areas relevant to financial services.

2. Categories/Topics Creation in Ender Turing

While creating a Category, consider adding a detailed description (explanation) of a Category if a name is not self-explanatory enough. This description will be passed on to AI as instructions for categorization with the Category name. The more accurate the description (explanation) you provide, the more accurate the automated categorization can be.

Here is an example:

Category name: Credit Card Reissue

Category description: A customer asking about a credit card reissue due to loss, theft, or expiration.

3. Ender Creation (defining rules, which conversations to categorize, and which categories to use)

To start automated categorization, you need to provide rules on which conversations to categorize and which to skip. You can also define multiple rules, where, for example, calls/tickets with Issues will be categorized using Procuct-related categories, and all others will be categorized using the main (high-level) list of Categories.

Such rules are created using Enders. The process of creating Ender is described here.

! Important—We recommend using less than 50 categories for single conversation categorization. You can create multiple Enders with corresponding rules to use different category lists for various situations, e.g., categorizing Products for issue-related conversations in addition to the main topic.

Below, you can see an example of defined rules:

Which conversations to categorize: conversations that have more than 50 words inside

Which Categories to use: All Generative Categories

3.1. Custom categorization logic/flow

The logic above is straightforward: use all Gen AI categories created at step 2 in categorization.

Select specific categories if you need to customize logic and use different categories (topics) for different conversations (based on rules defined in filters).

Below, you can see an example of defined rules:

Which conversations to categorize: conversations with the sales process inside

Which Categories to use: Use only a subset of categories

And after saving, It'll look like this.

Best Practices for Maximizing the Tool’s Value

Here are some best practices for maximizing the value of a categorization tool in a contact center:

  • Categories: To keep the tool relevant, the topics should be continuously reviewed and updated to reflect new products, business processes, trends, customer needs, or emerging issues.

  • Customize Categories for Your Business: Tailor the categories to fit your organization's specific products, services, and processes to ensure the tool addresses your unique operational needs. The list and rules can be as long and advanced as you get value for specific business processes.

  • Integrate with Analytics Tools and CRM: Connect the categorization tool with BI/DWH systems to analyze trends, customer behavior, and agent performance, enabling data-driven improvements in sales and service quality.

By following these practices, you can ensure the categorization tool delivers accurate, actionable insights and drives efficiency in customer service operations.

Did this answer your question?