You're an account administrator who recently started an Engagement+ survey or a manager with permission to view results for your hierarchy and direct reports, and the submissions are rolling in. Let's talk about how you can analyze the data from your survey, including exporting and taking action.
'Survey results' page
First things first, only account administrators will have full access to the results of a survey. If the 'admin and manager' option was selected when the survey was created, managers will have some visibility into Engagement+ results. Regardless of your role in 15Five and the settings selected during survey set up, all Engagement+ results will remain anonymous. Once at least five surveys have been submitted, the 'Survey results' page will begin to populate. Below is a screenshot of the results page.
To see the negative and positive score ranges, hover over the Score column header.
Keep reading to understand different views and actions you can take from this page.
Filter by people or groups
To dig into a specific group, group type, hierarchy, etc, use the 'People' filter. Also important to note that unless there are at least five submissions for a group, the results will not appear. This rule helps to keep people's identities anonymous and further create psychological safety. If a group only has three members, that group's results will not populate until there are at least five submissions.
List view vs Heatmap view
There are two different survey results views: List and Heatmap. List view gives you each theme, question, or group type in one full list with answer distribution charts to the right. From list view, you can dig a little deeper and view theme details or question details. Heatmap view gives you a visual of direct reports, hierarchies, and group types. From heatmap view, you can view how a group of direct reports scored per theme, how a hierarchy scored per theme, or how a group type scored per theme.
To toggle between views, use the icons in the screenshot below.
From list view, use the 'View by' filter and select 'Themes', 'Questions', or 'Group types'.
View by Themes
When viewing by Themes on the 'Survey results' page, there are some additional steps you can take to understand the results. If survey settings allow, you can also respond to feedback using the Themes view.
1️⃣ Easily see how many questions were asked for each theme. To expand and view the questions for each theme, click 'View questions (#)'.
2️⃣ Click on 'Theme details' under the theme itself to see the theme definition, the score meaning, and suggested actions to increase this theme's score going forward.
To take things a step further, click on the 'Learn more' at the bottom of the modal. You will be redirected to our Best-Self Academy for a list of actionable next steps to increase engagement for the theme in question.
3️⃣ Hover over the answer distribution bar to see what % of submitted answers were positive, neutral, or negative.
4️⃣ Use the grey up/down arrows at the top of the 'Score' column to sort ascending or descending. This sort is helpful when you have a long list of themes to analyze.
5️⃣ Expand the View questions option and then click View details to see questions that received feedback and response to that feedback. Only account administrators can respond to confidential feedback. Managers can see confidential feedback, if settings allow, but cannot respond to feedback. For more information on responding to Engagement+ feedback, see this article.
View by Questions
When viewing by Questions on the 'Survey results' page, there are a couple additional steps you can take to understand the results. By default, the questions will appear in the order that they were asked on the survey. If you would like to sort the questions by other columns, feel free to do so using the grey up/down arrows. If survey settings allow, you can also respond to feedback using the Themes view.
1️⃣ Hover over the answer distribution bar to see what % of people submitted each answer.
2️⃣ Click on View details under any question to be taken to the 'Question details' page. The question details provides you with a breakdown of each answer, the number of respondents that selected that answer, and a % for each answer option.
Also included on the 'Questions details' page is a section titled 'Responses' that displays confidential responses left by survey participants. Click Respond to the right of the feedback that you would like to reply to and write your response. If the feedback does not have a Respond option to the right, that means the survey participant is not accepting responses and wanted their feedback to be delivered without additional replies. Only account administrators can respond to confidential feedback. Managers can see confidential feedback, if settings allow, but cannot respond to feedback. For more information on responding to Engagement+ feedback, see this article.
3️⃣ If your survey included Text, Yes/No, or Multiple choice questions, your View by questions chart will look more like this.
You can still sort and view question details for custom questions, regardless of what type of question was asked.
View by group types
When viewing by Group types on the 'Survey results' page, you can see how engaged certain groups are on a high level. Each group will be listed along with their overall answer distribution and what % of answers were positive, neutral, or negative for the group. Reminder that results will only appear for a group if 5 or more of their member have submitted their surveys.
Sort column headers
On the 'Survey results' page, you can sort the column containing Themes/Questions/Group types and column containing the Score to quickly dive into both ends of the spectrum. To sort ascending or descending, click on the two arrows to the right of the column header.
Heatmap view gives you a high level score view organized by direct reports, hierarchies, and group types. Use the 'View by' filter and select 'Direct reports', 'Hierarchies', or 'Group types'.
Heatmap view allows you to easily digest how engaged multiple groups of people are, per theme. This view shows you each theme's overall score, along with the corresponding color for that score. Having all scores and colors showing on one page allows account administrators and managers to easily understand which groups and themes need more attention or which groups are highly engaged.
View by Direct reports
View by direct reports to see all managers and how their group of direct reports scored per theme. In the below example, Natalie Lee-Walsh's 5 direct reports have an overall Autonomy score of 49; compared to the company's overall Autonomy score of 53. If any group of direct reports had an autonomy score of let's say 95, it would be interesting to understand why their score was so much higher than the company overall score and all other group's scores.
If any group of direct reports, hierarchy, or group type does not include at least 5 submissions, the score will not appear for that group. In the below example, Leah and Seth only have 4 and 2 direct reports respectively. Instead of showing the score, we simply use a '-' to note that there are not enough submissions for information to appear.
View by Hierarchies
Change the 'View by' option to 'Hierarchies' to get each theme's score, per hierarchy. All reviewers in 15Five will have their own column in the hierarchy view. In the below example, the company has 6 reviewers total. Some hierarchies (Natalie Lee-Walsh) are more engaged than other hierarchies (Salome Simoes or Victoria Noss). Is it possible to connect with Natalie or her team and see what has been working well for them?
View by Group types
Viewing by group types allows you to see all groups and their scores per theme. Again, making it easy for you to see, side by side, how engaged groups are for each theme. In the below example, the two divisions are R&D and Revenue Organization. You can compare these two divisions to the overall score for each theme.
One of the main differences between list view and heatmap view is the answer distribution option which shows how many people answered positively, neutral, or negatively. Answer distributions are only available on list view.
As soon as the 'Survey results' page appears, account administrators (and possibly managers) can also download the survey data using the 'Download' option at the top right of the page.
See the screenshot below for a look into the CSV download. XLSX download is also available.