🚨 Alert
This article explains how to summarize open-text feedback using legacy reporting options, which will be sunset in 2025. As of November 2024, leaders can access new and improved engagement results through the HR Outcomes Dashboard.
Your organization just completed an engagement survey, and it's time to go over the results. But when it comes to filtering through open-text responses to uncover themes and insights, things can get overwhelming. That's why we created 15Five AI: an AI-powered assistant in 15Five. Within 15Five's Engagement feature, 15Five AI allows leaders to automatically categorize and summarize open-text feedback into themes based on Engagement Drivers — saving you hours and enabling you to quickly spot where your organization needs to take action.
In this article, you will learn...
- How 15Five AI works in Engagement
- How to summarize open-text Feedback using 15Five AI
- How to enable/disable AI functionality in Engagement
Access and availability
⛔️ Required access to Engagement results.
👥 This article is relevant to Engagement admins and any individual with full results access.
📦 This feature is available in the Engage, Legacy Perform, and Total Platform pricing packages.
Note
We take data security very seriously. When utilizing 15Five AI, you can rest assured that we remove all personally identifiable information so that your data is secure. Read more about how we protect your data with our AI features.
How 15Five AI works in Engagement
15Five AI in Engagement enables HR leaders & managers to easily and effectively analyze open-text feedback provided to Dynamic Feedback, the eNPS question, or custom questions so you can better understand how to take action on open-text responses. Cut down on the time spent deciding which data is important and spend more time knowing where to take action!
Here's how the process works:
- Remove PII. 15Five AI removes all personally identifying information from all open-text Dynamic, eNPS, and Custom feedback responses.
- Sort and assign responses. AI sorts through open-text responses and tags them with the Engagement Driver that each response is connected with.
- Assign a confidence score. AI assigns a confidence score for each response for how confident it is that the response is correlated with the Engagement Driver. If the score doesn't meet confidence standards, the response won't be associated with the Driver.
- Synthesize responses into summaries. Finally, AI synthesizes individual responses into overarching Driver themes and creates unique Driver summaries at both the organization and group-level, making it easier for leaders to quickly understand their survey results.
Steps to summarize open-text Feedback
- ✅ Leaders with full results access: All comments from employees and AI insights are available to Full Access Leaders. To protect employee confidentiality, comments can only be filtered by one group type. This group type is the Feedback Filter that was selected during the process of creating the engagement campaign. Full Access Leaders can filter by any group within that group type as long as the group meets confidentiality standards.
- ❌ Leaders with limited results access: Limited Access Leaders only have access to the comments from employees in the groups they have results access for, granted those groups meet confidentiality standards. Limited Access Leaders cannot filter results by group or generate AI insights.
- Once you complete an engagement survey, click on Engagement in 15Five's main, left-hand navigation.
- [HR Admins only] You'll land on the Engagement Overview page in 15Five. From here, click Go to Engage to open the Engage Portal.
- Click on Feedback in the main, left-hand navigation of the Engage Portal.
- Make sure the correct campaign is selected in the "Comments from" field at the top of the page.
- Click Generate insights at the top of the screen. 15Five will begin processing your responses, categorizing the responses into driver themes and creating summaries of the responses within each theme.
- Once the insights are generated, the table will display a list of Engagement Driver themes. These Driver theme rows will include the number of responses correlated with that Driver, as well as a summary of all of the responses within the Driver theme.
- Click on a Driver name to view individual responses that were included in the AI summary.
- Use the Group filter at the top of the page to see a unique summary of the responses that fall into each Driver theme for that group. The filter option you'll see here is the Feedback Filter that was selected during the process of creating the engagement campaign (in the example below, the selected Feedback Filter was "Manager," meaning it's possible to view results for all managers whose teams met confidentiality standards for the engagement survey).
Note
Only leaders with full results access can filter comments. Leaders with limited results access cannot filter comments.
Enable/Disable AI functionality in Engagement
This feature is turned on by default. If you would like to turn the feature off you can do so by following the steps below.
- Click on Engagement in 15Five's main, left-hand navigation.
- [HR Admins only] You'll land on the Engagement Overview page in 15Five. From here, click Go to Engage to open the Engage Portal.
- Click on the Settings gear in the top, right-hand corner of the Engage Portal and select 'Settings' from the dropdown menu.
- You're now on your company's Engagement feature settings page. From here, click on the Organization settings tab.
- Expand the 'Results Access' section using the arrow to its right.
- Toggle off the "Enable AI Insights on Feedback" option.