Survey Integrity Hinges on Honest Answers
Surveys are critical tools utilized by organizations to gain insights into various dimensions of the employee experience, including job satisfaction, engagement, and perceptions of organizational culture. By systematically collecting and analyzing data, organizations can make informed decisions that enhance workplace environments and employee well-being.
Accurate survey responses are essential to the process because they reveal valid and reliable patterns and correlations among workplace variables. But how do you go about getting accurate and honest answers?
3 Things That Compromise Truthful Responses
Factors that can significantly impact the reliability of survey data include:
- Unclear question framing
- The tendency for respondents to ‘game’ their answers such as providing answers they believe are expected or favorable
- The absence of a psychologically safe environment where employees are reluctant to share their perspectives, especially on sensitive issues
Overcoming these barriers requires intentional survey design rooted in behavioral science that prioritizes clarity, anonymity, and context, while fostering a culture of trust to ensure the feedback collected is both authentic and actionable.
How Atana Gets Genuine Input
Atana takes a unique approach to addressing the shortcomings of traditional surveying by leveraging realistic workplace scenarios within training courses. Taken within the context of learning, the scenarios create a relatable environment for employees that encourages authentic responses. By focusing on four key areas, Atana’s methodology transforms how organizations gather employee feedback.
Atana takes a unique approach to addressing the shortcomings of traditional surveying by leveraging realistic workplace scenarios within training courses.
1. Establish Psychological Safety
1. Establish Psychological Safety
Psychological safety is a cornerstone of eliciting honest feedback. Employees are more likely to share candid responses when they trust their input will not result in judgment or retaliation. Atana’s surveys build this trust through guaranteed confidentiality and an approach that uses growth-oriented questions in the context of training that emphasize improvement rather than punishment.
Given the limitations of engagement surveys, organizations seeking comprehensive insights into employee perceptions should supplement findings with additional data. Capturing employee data in a specific context is one way that can be done.
In learning and development (L&D), in-context surveying involves assessing employees' attitudes and perceptions about a workplace behavior while they’re learning about it. For example, if an organization’s managers are training to initiate difficult conversations with direct reports, it’s helpful to get a sense of the managers' feelings about conflict and their own abilities to handle employee defensiveness or anger—issues that often arise in a difficult conversation.
2. Minimize Bias Through Contextualization
Social desirability bias causes people to answer questions in a way that makes them look good rather than convey what they truly think or do. It’s a common challenge that leads many workplace surveys to get "the right answers" rather than the real ones. Atana addresses this challenge by immersing employees in realistic scenarios and prompting them with questions in real time, uncovering their actual behaviors rather than their perceived ideals. Here’s an example:
- When taking harassment prevention training, respondents are presented with a scenario where an employee asks a co-worker to stop sharing jokes of a sexual nature.
- Respondents are asked to consider the situation in the context of their own workplace, co-workers, and organizational leaders.
- Survey questions capture their perceptions, attitudes and perceived abilities:
- Do I agree that sharing jokes of a sexual nature at work is inappropriate?
- Do my organization’s leaders set clear expectations about what is and is not appropriate in the workplace?
- Would my co-workers support speaking up like this if someone crosses the line?
- Do I have the skills to speak up against inappropriate behavior?
- Would I feel safe doing so?
This approach engages respondents with realistic workplace dynamics they can relate to and questions that help them reflect on what they are likely to do (or not do)—leading to more genuine and actionable insights.
3. Frame Questions for Growth
Traditional surveys often focus on identifying problems, which can inadvertently create defensiveness among respondents. Atana's approach reframes this narrative by concentrating on positive workplace behaviors: effective communication, maintaining a culture of respect, ethical decision-making, and fostering inclusivity.
By shifting the emphasis from punitive judgments to developmental opportunities, the survey becomes more than a mere data-gathering exercise. The questions invite self-reflection and offer individual value, providing employees with the “what’s in it for me?” and encouraging them to engage constructively. As a result, participants are more likely to provide feedback that highlights both organizational strengths and meaningful areas for growth.
The survey becomes more than a mere data-gathering exercise…providing employees with the “what’s in it for me?”
4. Encourage Engagement Through Storytelling
4. Encourage Engagement Through Storytelling
Stories are one of the most effective ways to capture attention and spark meaningful reflection. Atana builds storytelling into its surveys through video vignettes and workplace scenarios that resonate with employees' real experiences. When people encounter familiar situations instead of abstract questions, they engage both emotionally and intellectually with the content. This storytelling approach keeps respondents from disengaging and helps prevent superficial responses, leading to deeper insights and more actionable data that organizations can actually use.
By addressing these critical areas, Atana’s methods set a new standard for workplace surveys, ensuring that feedback is not only honest but also meaningful for driving organizational growth and improvement.
About the Author
John Louviere, Ph.D. | Atana VP of Content and Research
Dr. Louviere has over 20 years of practical and theoretical research experience utilizing state-of-the-art learning analytics methodologies to assess and design online learning. He is passionate about applying theory-influenced innovation to design and deliver excellent and effective learning experiences.
John Louviere, Ph.D. | Atana VP of Content and Research
Dr. Louviere has over 20 years of practical and theoretical research experience utilizing state-of-the-art learning analytics methodologies to assess and design online learning. He is passionate about applying theory-influenced innovation to design and deliver excellent and effective learning experiences.
References
Psychological Safety
- Edmondson, A. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2), 350–383.
- Kahn, W. A. (1990). Psychological conditions of personal engagement and disengagement at work. Academy of Management Journal, 33(4), 692–724.
Social Desirability Bias
- Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46(3), 598–609.
- Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24(4), 349–354.
- Fisher, R. J. (1993). Social desirability bias and the validity of indirect questioning. Journal of Consumer Research, 20(2), 303–315.
Framing Effect
- Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211(4481), 453–458.
- Levin, I. P., Schneider, S. L., & Gaeth, G. J. (1998). All frames are not created equal: A typology and critical analysis of framing effects. Organizational Behavior and Human Decision Processes, 76(2), 149–188.
Storytelling and Engagement
- Green, M. C., & Brock, T. C. (2000). The role of transportation in the persuasiveness of public narratives. Journal of Personality and Social Psychology, 79(5), 701–721.
- McAdams, D. P. (1993). The stories we live by: Personal myths and the making of the self. Guilford Press.
Survey Design and Bias Reduction>
- Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge University Press.
- Joinson, A. N. (1999). Social desirability, anonymity, and Internet-based questionnaires. Behavior Research Methods, Instruments, & Computers, 31(3), 433–438.
Cognitive Dissonance
- Festinger, L. (1957). A theory of cognitive dissonance. Stanford University Press.
- Aronson, E. (1999). The power of self-persuasion. American Psychologist, 54(11), 875–884.