Article by Molly Burke, RMS Research Analyst –
It goes without saying – some level of pre-testing is a must before launching a full-scale survey.
Survey Sampling International (SSI) defines a pre-test as a questionnaire that is tested on a statistically small sample of respondents before a full-scale study. The benefits of pre-testing cannot be overstated whether you go to the extent of a soft launch or not. The real issue is, in an industry where time is often of the essence and findings need to be turned around yesterday, it’s difficult to budget the time into a study to conduct a thorough pre-test. In some cases, one could argue a pre-test is not necessary, such as a renewal of a yearly survey, or an online survey that is only being sent to a small population. Here are some reasons why pre-testing your online survey is vital. Keep in mind, some of these benefits will also apply to other methodologies including phone surveys.
- Estimating a response rate.
Likely, this is one of the most common reasons surveys are pre-tested. When you send 1,000 survey invitations out and obtain 35 completes, you know that your response rate overall will hover around 3.5%. This helps you guide future sample purchases and determine how many invites you need to send to reach your quotas, without having to overspend.
- Fix wording issues on questions that are difficult to answer.
As survey writers, we’ve all been in situations where we spend so much time engulfed in a survey that we overlook or don’t catch some minor issues. By pre-testing your survey, you are getting a fresh perspective on the question language. Doing this on a smaller scale, such as an email to other colleagues, can accomplish the same results.
- Estimating the length of time to complete the survey.
This factor is probably the second of the two most common reasons surveys are pre-tested. By reviewing the time stamps of how long it took the respondent(s) to take the survey, you can determine whether you can add those two other key questions your client wanted to add or determine if you need to cut back on the scope.
- Understanding points of likely dropout.
We’ve often spoken about better engaging survey respondents in past blog posts and this benefit speaks directly to that. You can accomplish this a few separate ways. One would be to look at data to see which questions carried the highest likelihood of dropping out. Another more personalized method would be to follow-up with select survey respondents by phone to discuss their survey experience (if you have access to their telephone number through an internal or client panel).
- Improving your subject line or invite text.
Another benefit of a pre-test is to test the effectiveness of your subject line or invite text. Spam filters are a real concern when it comes to online surveys. Therefore, if you have time to pre-test, you might want to think about using a few different subject lines or invite text and then see which of those worked best.
Are you thinking about conducting an online survey for your business? Contact Sandy Baker at 315-635-9802 or SandyB@RMSresults.com.
Relational RMS Blogs:
Qualitative and Quantitative Research: Distinctions and Uses
Recruiting the Right Participants for Your Focus Groups: Best Practices
How to Design Your Next Feasibility Study
About the Author – Molly Burke
Molly supports the design, administration, and analysis of RMS Research Analytics Division projects works to ensure that all reporting follows RMS guidelines for quality and leverages her industry knowledge to enhance recommendations, particularly for RMS healthcare clients.
It’s good to know. We’re here for you.
Call us today, to see how we can help your organization.
Interested in conducting a market research project with RMS?
Contact our Vice President of Corporate Development, Sandy Baker at SandyB@RMSresults.com or call 1-866-567-5422.
About RMS
Research & Marketing Strategies, Inc. (RMS) is a full-service market research firm in Central New York. Formed in 2002, RMS helps organizations that are looking to know more about their customers and/or potential customers. They conduct surveys, focus groups, mystery shopping, studies and analysis. Each project is customized and gets personal attention by the best in the business. RMS has a reputation for getting results and offers an independent means to conduct telephone, on-line and mail surveying, In-depth interviews, intercept interviews, and participant recruitment as well as focus group hosting through QualiSight, its onsite call center and focus group facility. Taking advantage of the region’s reputation for being a great market study barometer, RMS recruits and moderates for focus groups, community forums and town meetings.
