How many market researchers does it take to change a light bulb? 30. One to change the bulb, and 29 to get its significance. Oh, you think it’s a bad joke. I agree. But you and I make for a sample size of two and that is clearly not enough to make the conclusion.
A sample size determination is no joke. In fact, this is perhaps one of the more complex decisions to make in a survey research study. It impacts how assured you would be in your ultimate findings. Plus a good sample size calculation can help you confidently pick from close choices. Surely, it also impacts how much you will end up spending.
So, how do you select an ideal size of the sample for your study if you are not an accomplished statistician. Here are the four ways:
What is a homogenous group?
If you are looking for a safe, can’t-go-wrong type thumb rule, pick an appropriate sample size of 400 (385 to be precise) per homogenous group. What is a homogenous group? It is a cluster of members whose behavior is assumed to be similar to the other members of the group and different from non-members of the group. Typical examples of homogenous groups are males/ females, young/ old, smartphone users/non-user determine the target population.
So, is it that simple? Just take 400 of each number of respondents that form your customer base and you are ready to launch your study? Well, not really. Do that and your research is probably (almost certainly) going to go over-budget quickly.
The other end of this spectrum is the magic number of 30. You can choose a sample size of 30 (a little more, in case you provision for loss to data cleaning) for each of your homogenous group. Why 30 you ask? The easiest explanation is that if you pull 30 samples from a larger population randomly, these samples should start to mimic the population. Typically, that is what you want- Your sample should be a replica of the entire population you want to study. The more samples you pick, the better a replica it would be.
So why is this not the end of the discussion? Why not pick 30 per group every time? Well, because it makes two major assumptions- firstly, the homogenous groups are truly homogeneous. Secondly, the randomization is truly random. Neither of these assumptions work well in real-life scenarios.
Can a survey sample size be too large?
Yes, a survey can have too large of a sample size. While a larger sample size can provide more precise results, it can also be costly and time-consuming. Strike a balance between statistical significance and practicality when determining the ideal survey sample size.
Borrow from the wisdom of the experts
- So, if not 30 or 400, then what? The next easiest route is to borrow from the wisdom of the experts and use some thumb rules. The table below gives some sample size thumb rules that are used by practitioners often.
| Study Type | Minimum Size | Typical Size |
| Name Test | 100 per name tested | 200-300 per name and respondent category (for example, males vs females) |
| Package tests | 100 per package tested | 200-300 per package and respondent category |
| Ad testing | 150 per ad | 200-300 per ad |
| Concept/ Product test | 200 | 200-300 per concept/ product and respondent category |
| New product-market-penetration test | 200 | 300-500 |
| Market understanding | 500 | 500-1500 |
| Pricing study (Simple Monadic) | 60 per price level | 100-150 per price level |
| Pricing study (Van Westendorp) | 200 | 100-150 per respondent category |
| Multiple Linear Regression [Green (1991)] | 50+ 8 * no. of predictors | 20-50 per predictor |
| Linear Regression for testing importance of predictors[Green (1991)] | 104 + no. of predictors | 20-50 per predictor |
Adapted from Hyman, Michael & Sierra, Jeremy. (2010). Selecting a sample size for your customer survey. NMSU Business Outlook.
But do remember – these are just thumb rules and should work in most cases you would encounter.But they will not work in all scenarios so handle with care.
What is a good sample size for a survey?
A small sample size may not get you to the right conclusion of your study. However, a larger sample size might sound ideal. However, it might be prone to error or mismanagement of results. Either way, you might not get the desired results.
As per some statisticians, a sample size of minimum 100 participants can give you meaningful results. However, in certain comparison studies, researchers might look for a minimum of 5 participants per group. This is applicable in the field of study such as pharmacology and biological research. For clinical studies, researchers prefer having at least 100 participants in each group.
It is important to note that the minimum and maximum sampling depends on the time and budget of the research. It is stated that a good maximum sample size can be 10% of the chosen population. It should not exceed more than 1000 participants. Taking more than 10% will bring more or less the same results.
Example, in a population of 6000, 10% of this number will be 600. However, in larger cases, the number will be greater than 1000. For example, 10% of 30,000 people will be 3000 which is more than 1000. So you can take the maximum number i.e 1000 people.
It is recommended that one can choose the minimum respondents if the conclusion of the study will not have much consequences. Researchers must choose the maximum if the conclusions of the study can cause a serious impact on the rest of the population.
How to calculate the sample size for your survey?
1. Use online survey sample size calculator:
Use an online sample size formula with calculators like the one here. It will require you to understand concepts like margin of error, confidence level and response distribution, but the site does a good job of explaining the basics.
2. Calculate the sample size with this formula:
If you are feeling adventurous and want to calculate the sample size yourself, why not? If your target group of people has a large size of the population, you can use the following formula:
In this formula, n is the sample size
z is the confidence interval for the desired level of confidence (you can find z tables here)
s = estimated standard deviation
e = desired margin of error
At most times, the right sample size selection boils down to a trade-off between expected precision and cost to attain it. Getting the perfect sample size is critical to confident decision making. The four methods mentioned above should guide you in choosing the one that can augment your market research. Ensure that you have collected responses from your potential customers during the research. The Merren dashboard can assess figures given the significant results from the total number of people. This makes conducting market research a more meaningful endeavour.
Conclusion
Want to achieve meaningful results from your survey? Merren provides a free 14 day trial without any credit card commitments. You can 10x your response rate, more than the industry standard of survey responses. Our WhatsApp messenger survey brings a high response rate. Deploy customer feedback forms from messenger apps and launch your own customer satisfaction metrics. You can build custom-made Facebook messenger surveys and AMP email surveys. Supercharge the customer experience protocols in your organisation with Merren.