- 25/03/2020: Info regarding language availability
- 26/03/2020: Dealing with License limits
- 30/03/2020: New Version including sections for on-site Workers; issue with translations for
Some guidance and tips on the free Remote + On-Site Working Survey from Qualtrics
SAP Qualtrics is offering a number of free XM (Experience Management) solutions to help organisations manage the changes enforced by the COVID-19 epidemic. You find an overview of the rapidly changing and expanding offering on this link: heretohelp initiative.
Some critics may say “ok, it’s free, but it’s still marketing and therefore inappropriate.” and in that case this applies to this article as well. However, if offering help is also improving your brand and improving your brand is not allowed in times of crisis, then the conclusion would be that organisations shouldn’t offer help. And the best free help offered can’t be effective, if there is no information about it. That’s why we, like Qualtrics, decided to risk taking some flak, but still be out there and offer support for organisations to drive business continuity, while putting people first – as long as we keep getting the feedback that it’s helpful.
What does the Qualtrics Remote + On Site Working Experience Survey do?
The solution was correctly labelled as “Remote Work Pulse”, as it’s meant to be sent on a regular basis to monitor trends (“feeling the pulse”). The purpose is to understand how your remote workforce is feeling and whether they have what they need to be effective in their role, to understand what there role is in the current context, and to maintain their physical and emotional well-being.
On 27th March, the solution was amended under the new name “Remote + On-Site Work Pulse” to also include on-site and office workers to understand how they are coping with the changes during the COVID-19 pandemic. This makes sense, as every work context has its special challenges and front line workers in particular are anxious about their own safety. This new version comprises some new questions and others are re-worded. Questions aiming at one particular group are only shown to that Group, as their are some dynamic elements in the survey.
The solution is actually made up of two separate surveys and both come completely pre-configured and can be launched within an hour:
- The “Full remote + on-site Evaluation” (formerly “Remote work readiness Evaluation”) is a more comprehensive feedback starting with the emotional well-being but also asking about all aspects of remote working including organisation, communication, technology and belonging. Use this link to take a sample survey online.
- The Quick Check-In is literally just taking a minute to check the pulse of emotional well-being. It Looks the same for remote and on-site workers, but there is still a Change to the original version as the mood barometer has now 7 rather than 5 levels and is no longer using weather-associations to reflect mood.
How do we Get Access to the Qualtrics Remote Working Survey?
You have all the information to access the Remote Working Experience survey under this link – find the “get started” button. The content is changing on an ongoing basis.
If you are already a Qualtrics customer you’ll have access to this survey in your brand: log into your solution (in English language!) and navigate to “Projects”, click “Create new Project” and choose “Core XM” (It’s not under Employee XM!). Then you’ll see the section of COVID-19 related solution and you can pick “Remote + On-Site Work Pulse”.
If you are not a Qualtrics customer yet, no problem. Following the “get started” guidance under the link mentioned, you’ll be able to request access to a brand (the Qualtrics name for an instance). The process differs a bit by size of the organisation:
- below 500 employees: very few infos are required and access is granted almost instantly
- an online form needs to be filled in and provisioning of access can take a few hours
Note: at first sight, the Qualtrics overview documentation seems to suggest you have to load employee names and email addresses into Qualtrics. In fact, whilst this is possible, we don’t recommend this for most organisations, as it’s likely to delay the launch due to data cleansing and data privacy discussions. It is entirely possible to send the invitation link for the survey to all employees from your normal email system using a single re-usable link, which is anonymous, so individuals are not recognisable.
What’s needed for setting up our Remote +On-Site Survey?
Qualtrics provides a comprehensive guide under this link, so I won’t repeat that, but only share a few tips or point the spotlight on the most important parts.
Most importantly: if you are not a Qualtrics expert or if you want to be quick, just follow the wizard. You’ll be surprised, how easy it is.
A few tips to remember, while following the wizard:
- The company name you provide will be used in addressing the participants in the survey, so use the colloquial name rather than the full legal name to make it sound nicer
- You’ll be asked to provide regions / locations and organisational units. That’s for participants to choose from, so you can get a better picture in the reporting to spot things like “Colleagues in Germany tend to have internet bandwidth problems” or “The Sales Team in Kenya is missing social interaction”. This is necessary, as you are using anonymous links, so the system will not know, which employee has provided which answers (you could use non-anonymous as well, we’ll get to that later).
- When amending the regional and organisational choices, make a quick list on paper first to decide on the sequence (alphabetical is easy to use). Then start by overwriting the given choices. Delete the last ones, if there are too many. Use “add” button, if you need more. This way you won’t need to go into the survey edit mode to change sequence etc. later, but can do everything in the wizard.
- If the choices here are too detailed, it could be possible to identify individuals. Two ways to mitigate that risk:
- point it out to people and allow them to skip these questions (or add an NN option), if they don’t feel comfortable.
- Make sure the choices are high level enough to avoid this
- When you come to the survey distribution, I recommend generating the single generic link and send it out through your corporate email system with some appropriate introduction text. Resist the fancy options. E.g.: what good is the barcode that can be scanned by mobile phones? When people are working from home you have nowhere to put it. This way, you also save yourself the often time-consuming task of preparing data to load into Qualtrics.
- Once you’ve sent the first link via email, consider reminders after a couple of days. Make it very clear in the reminder email that it shouldn’t be filled in twice. The same applies, if you offer the link elsewhere, e.g. your intranet page.
- It is recommended to follow up with so called pulses, probably mostly with the quick check-in pulse rather than the full survey. Use some signposting to tell people about this at the beginning, so they don’t think the follow-up pulse is just a reminder for the original survey and delete it.
- Once the results are in, check out the standard report. There is a lot of valuable analysis available out of the box. Here’s just a brief glimpse with some sandbox data:
Is this Qualtrics Survey localised?
“Right now, the new solution is only available in English, though that will change very soon.
The old Version (replaced 27th March) is now available in further languages including, but not limited to German, French, Spanish, Dutch and Italian. As long as those languages are not available for the new version, you can still access the old one, by setting your account language to, say, German, before starting the survey creation.
For those still using the old Version available before 27th March, Adessa Group is also providing a Swedish translation (questionnaire only) for free download to bridge the gap, but as Qualtrics Standard translations are expected very soon, they are currently not being updated.
Finally: You can also download the German translation of the new solution on our free download page.
However, you can also translate it yourself. You’ll find infos in the Qualtrics documentation. I recommend making use of the built-in Google translation and use that as your basis. Note that some Google translations go pretty wrong, mostly due to the somewhat, unusual Grammar used in the original English text.
There are no localisations announced going beyond language. Qualtrics allows for amending the survey flow based on existing information, so you could ask different questions for, say, France. However, that requires some configuration and to some extend defeats the purpose of a quick to deploy out-of the box solution.
Note: Some users are currently facing issues, where translation feature as well as the layout changes (such as uploading logo) are not available. If this is the case for you and you need these Features, please contact Qualtrics Support for help.
What about Loading Participant Data into Qualtrics?
The beauty of the anonymous solution is that it saves you from two of the biggest barriers for quick deployment:
- No data cleansing or data loading
- No data privacy arrangements and discussions, because there is no data attributable to an individual kept in the solution
Of course, you can load participant data (if you are familiar with employee XM, note that it’s not taken from the employee directory, but from the contact directory). There are some benefits in that, as you don’t have to ask the demographic questions and have more relatable data to use in reporting. You could also configure the system to respond with direct automated actions to individual answers. But this would all contribute to an extended implementation time and take us away from the single day deployment, which is easily feasible with the out-of-the-box solution.
Also note that, unlike dashboards in employee XM, the reports in this solution have no minimum anonymity threshold.
Can we Amend the Standard from Qualtrics to Match our Bespoke Remote Working Context?
Yes, you can. However, as stated above, try to go lean on this as it may just delay the launch beyond the time, where it’s actually still useful. It may also require a lot of documentation reading and come with the risk of messing up, or alternatively need external consultants with Qualtrics certification to help.
However, if you have the resources to get it done quickly, some amendments may add value. Examples include:
- Changing the layout – most notably adding your company logo
- Adding or removing answer choices
- Making some answers mandatory
- Hiding some questions not relevant for certain departments or locations
- Adding steps dynamically that ask questions or suggest actions based on answers in previous questions. E.g., if someone answers they are feeling not well at all, you might suggest a phone number to call
- Adding diagrams to the report to break down some more answers by geography or department.
Finally, a tip for existing Qualtrics EX customers: if your licence allows, the best way forward for you may be to create an engagement survey and import the questionnaire from the Remote Work Solution. That way, you can make use of the dashboard builder with anonymity threshold, the hierarchies, and the employee directory.
Help, I’ve hit a License Limit!
As this is a free version, it is to be expected that there are limitations to make sure there is anough capacity for the thousands of organisations actually making use of this offer and to avoid it being exploited for other purposes. There are two limits we’ve spotted, but those may vary over time depending on load:
- Number of Surveys:
In our examples the number of active surveys was mitited to one active survey, but that shouldn’t be a Problem, as you would close the initial survey anyway before sending out a follow-up pulse, so, if you get this message, when Publishing a Change in your Survey, it’s time to close the last Survey.
That’s done in the survey list, choosing “close” in the menu that opens, when clicking the 3 dots on the hight hand side:
- Number of Questions per Survey
The long survey (Full Remote + On-Site Evaluation) is already maxing out the number of questions allowed in a survey under the free license. In this context it’s important to know that pure text fields without real questions like the introduction text or section headers also count as questions, but that a list of items to choose from or a list of statements to agree/disagree with under one header (e.g. “Matrix Questions”) count as a single question.
So, if you want to add more questions to the out-of-the-box version, you need to re-purpose some of the existing “questions”. Easy, if you can replace one you don’t need. Otherwise you may want to get rid of section headers or combine single questions creatively into a matrix. The system will tell you as soon as you try to create a new question, if you have hit your limit.
When, If Not Now?
I appreciate that there is a lot of uncertainty and workload on HR teams at the moment. But when, if not now, is the time we should understand the experience our employees have working in difficult circumstances, and strive to improve? For those organisations, who still need a tool to make this listening exercise efficient and effective, the free solution Qualtrics provides is an option to achieve that with minimum time and resources. Therefore, I encourage you to look into it and deploy it with minimum amendments to be quick and without spending money on external consultants.
Let’s make sure we understand the needs of our colleagues and that there is a helping hand, when it’s needed.