You're an account administrator who recently started an Engagement+ survey or a manager with permission to view results for your hierarchy and direct reports, and the submissions are rolling in. Let's talk about how you can analyze the data from your survey, including exporting and taking action.
First things first, only account administrators will have full access to the results of a survey. If the 'admin and manager' option was selected when the survey was created, managers will have some visibility into Engagement+ results—namely for their team or hierarchy only. Regardless of your role in 15Five and the settings selected during survey set up, all Engagement+ results will remain anonymous. Once the confidentiality threshold for submissions has been met, the survey results will begin to populate. Below are the various tabs and options for analyzing your survey results.
The Summary tab starts by displaying an 'Engagement score' gauge. This score is an average of all theme scores—aka how engaged your people are on across all topics. The Summary tab, aims to help account administrators and managers better understand the survey results on a high level. This tab is only available for Plus customers.
Below the score, there is a section titled 'Comparison'. You can view by group types to change how the scores are displayed. Also included in the 'Comparison' section is the Participation column. This column speaks to what percentage of people in the group/group type have completed their surveys.
The 'Themes' tab is your hub for all themes/work needs and questions that were covered in the survey. You can filter using the 'People' filter and view results by themes or by questions.
Filter by people or groups
To dig into a specific group, group type, hierarchy, etc, use the 'People' filter. Also important to note that unless there are at least five submissions for a group, the results will not appear. This rule helps to keep people's identities anonymous and further create psychological safety. If a group only has three members, that group's results will not populate until there are at least five submissions.
View by Themes
When viewing by Themes, there are some additional steps you can take to understand the results. If survey settings allow, you can also respond to optional feedback using the 'Themes' view.
1️⃣ Easily see how many questions were asked for each theme. To expand and view the questions for each theme, click View questions (#).
2️⃣ Click on Theme details under the theme itself to see the theme definition, the score meaning, and suggested actions to increase this theme's score going forward.
3️⃣ Hover over the answer distribution bar to see what % of submitted answers were positive, neutral, or negative.
4️⃣ Use the grey up/down arrows at the top of the 'Score' column to sort ascending or descending. This sort is helpful when you have a long list of themes to analyze.
5️⃣ Expand the View questions (#) option and then click View details to see questions that received feedback and response to that feedback. Only account administrators can respond to confidential feedback. Managers can see confidential feedback, if settings allow, but cannot respond to feedback. For more information on responding to Engagement+ feedback, see this article.
View by Questions
When viewing by Questions on the 'Survey results' page, there are a couple additional steps you can take to understand the results. By default, the questions will appear in the order that they were asked on the survey. If you would like to sort the questions by other columns, feel free to do so using the grey up/down arrows. If survey settings allow, you can also respond to feedback using the Themes view.
1️⃣ Hover over the answer distribution bar to see what % of people submitted each answer.
2️⃣ Click on View details under any question to be taken to the 'Question details' page.
The question details provides you with a breakdown of each answer, the number of respondents that selected that answer, and a % for each answer option.
Also included on the 'Questions details' page is a section titled 'Responses' that displays confidential responses left by survey participants. Click Respond to the right of the feedback that you would like to reply to and write your response. If the feedback does not have a Respond option to the right, that means the survey participant is not accepting responses and wanted their feedback to be delivered without additional replies. Only account administrators can respond to confidential feedback. Managers can see confidential feedback, if settings allow, but cannot respond to feedback. For more information on responding to Engagement+ feedback, see this article.
3️⃣ If your survey included Text, Yes/No, or Multiple choice questions, your View by questions chart will look more like this.
You can still sort and view question details for custom questions, regardless of what type of question was asked.
To see the negative and positive score ranges, hover over the 'Score' column header.
The 'Comparison' tab creates a dedicated space for comparing results from segment to segment. This tab also includes a 'Participation' column to help you understand the level of participation for each group, group type, manager, or hierarchy. Participation can be a very telling factor to the results of your engagement survey.
There are two different survey results views on the Comparison tab: List and Heatmap. List view is the default view and gives you each theme, question, or group type in one full list with answer distribution charts to the right. From list view, you can dig a little deeper and view theme details or question details. Heatmap view gives you a visual of direct reports, hierarchies, and group types. From heatmap view, you can view how a group of direct reports scored per theme, how a hierarchy scored per theme, or how a group type scored per theme.
To toggle between views, use the icons in the screenshot below.
Use the 'View by' filter and select Groups, Hierarchies, or Group types.
View by group types
When viewing by group types on the 'Survey results' page, you can see how engaged certain groups are on a high level. Each group will be listed along with their overall answer distribution and what % of answers were positive, neutral, or negative for the group. Reminder that results will only appear for a group if 5 or more of their member have submitted their surveys.
Sort column headers
On the 'Survey results' page, you can sort the column containing Themes/Questions/Group types and column containing the score to quickly dive into both ends of the spectrum. To sort ascending or descending, click on the two arrows to the right of the column header.
Heatmap view gives you a high level score view organized by direct reports, hierarchies, and group types. Use the 'View by' filter and select Direct reports, Hierarchies, or Group types.
Heatmap view allows you to easily digest how engaged multiple groups of people are, per theme. This view shows you each theme's overall score, along with the corresponding color for that score. Having all scores and colors showing on one page allows account administrators and managers to easily understand which groups and themes need more attention or which groups are highly engaged.
View by direct reports
View by direct reports to see all managers and how their group of direct reports scored per theme. In the below example, Natalie Lee-Walsh's 5 direct reports have an overall Autonomy score of 49; compared to the company's overall Autonomy score of 53. If any group of direct reports had an autonomy score of let's say 95, it would be interesting to understand why their score was so much higher than the company overall score and all other group's scores.
If any group of direct reports, hierarchy, or group type does not include at least 5 submissions, the score will not appear for that group. In the below example, Leah and Seth only have 4 and 2 direct reports respectively. Instead of showing the score, we simply use a '-' to note that there are not enough submissions for information to appear.
View by hierarchies
Change the 'View by' option to Hierarchies to get each theme's score, per hierarchy. All reviewers in 15Five will have their own column in the hierarchy view. In the below example, the company has 4 reviewers total. Some hierarchies (Natalie Lee-Walsh) are more engaged than other hierarchies (Salome Simoes or Victoria Noss). Is it possible to connect with Natalie or her team and see what has been working well for them?
View by group types
Viewing by group types allows you to see all groups and their scores per theme. Again, making it easy for you to see, side by side, how engaged groups are for each theme. In the below example, the two divisions are R&D and Revenue Organization. You can compare these two divisions to the overall score for each theme.
One of the main differences between list view and heatmap view is the answer distribution option which shows how many people answered positively, neutral, or negatively. Answer distributions are only available on list view.
As soon as the 'Survey results' page appears, account administrators (and possibly managers) can also download the survey data using the Download option at the top right of the page.
See the screenshot below for a look into the CSV download. XLSX download is also available.