How to Conduct a Pilot Study

If you have a plan for a larger scientific study, it's often a good idea to do a pilot study first. With a pilot study, you pre-test the methodology you plan to use in the full study using a smaller sample. The pilot helps you find any problems with your planned methodology so you can correct those before you invest significant time and money on the full study. If you choose your sample following the same guidelines as you've set for the full study, your pilot can also give you an idea of what the results might be for your full study. A successful pilot study can also help you fulfill your funding needs for your full study by strengthening your grant applications.[1]

Part 1
Part 1 of 3:

Designing Pilot Study Protocol

  1. Image titled Conduct a Pilot Study Step 1
    1
    Identify the larger idea or project your pilot study is based on. Ideally, if your pilot study is successful, it will lead to a much larger study with a more expansive scope and extensive budget. In your pilot study protocol, describe how the pilot study will pave the way for that larger study to become a reality.[2]
    • Ideally, you've already planned the methodology for the full study. Then, you can use the pilot study to assess how doable that methodology actually is.
  2. Image titled Conduct a Pilot Study Step 2
    2
    List the feasibility questions you plan to answer with your pilot study. Generally, you're using a pilot study to determine if you can actually do the full study (assuming you have appropriate funds and resources available). Look at the planned methodology for the full study and focus on the things you're not sure will work. These are the questions you need to ask. The objective of your pilot study is to answer those questions.[3]
    • For example, if your study will take several months to complete, you might wonder if you'll be able to retain participants through to the end. Your feasibility question would be something like, "Can we keep participants in the study through the end?"
    Advertisement
  3. Image titled Conduct a Pilot Study Step 3
    3
    Provide a concrete measure to determine feasibility. Once you've stated the questions your pilot study plans to evaluate, describe how you'll answer those questions. A quantifiable measure enables you to make an objective determination if your full study is feasible based on the pilot study.[4]
    • For example, if you're concerned about whether your participants will stick it out through a long-term study, you might write: "The full study is feasible if the retention rate for the pilot study is 90% or greater."
    • You might have multiple criteria that you're evaluating through the pilot study. If so, list each of these separately along with a concrete measure for determining the feasibility of the full study.
  4. Image titled Conduct a Pilot Study Step 4
    4
    Calculate your sample size for the pilot study. You often don't have to do formal sample size calculations for a pilot study. However, you do need to have enough participants that your observations will be useful. Generally, include 10-20% of the number of participants planned for your full study.[5]
    • The objective of the pilot study isn't necessarily to predict anything about the outcome of the full study, so you don't have to worry about your sample size being too small to generalize to the larger population.
    • Keep in mind the money and resources you have available when you determine the sample size for your pilot study. You want to keep the sample size within your means to basically do everything on your own locally, since you're unlikely to have access to money for travel or professional services.
    5. Advertisement
Part 2
Part 2 of 3:

Running the Pilot

  1. Image titled Conduct a Pilot Study Step 5
    1
    Document training of other researchers working on the pilot. If you bring in other researchers to work with you on your pilot study, create a detailed record of their training sessions, including the materials they're provided and the instructions they're given. This record enables you to correct any errors in training before the full study.[6]
    • For example, if you have randomization procedures to control bias in the study, your researchers need to understand how to implement those procedures. If your instructions are confusing, your study could end up being biased.
    • Plan on keeping the pilot researchers with you for the full study. They can help train any additional researchers you bring on board.
  2. Image titled Conduct a Pilot Study Step 6
    2
    Recruit participants that cover the entire range of your full study. Follow the same recruiting methods you've outlined for your full study to recruit the same types of people. Covering the full range enables you to more easily project that the results of the pilot study will be replicated by the full study.[7]
    • For example, if your full study will include participants in 3 age groups ranging from 18 to 52, your pilot study would ideally include participants from each of the 3 age groups you've delineated for the full study. It might turn out that your recruiting methods work for one of the age groups but aren't as effective for the others. Similarly, you might find that one age group is more likely to stay through the whole study than others.
    • Evaluate how difficult it is to recruit participants and how long it takes for you to recruit the number of participants you need. You can scale this to determine if the recruiting methods you used will work for the full study or if it would take too long for you to get enough participants on board.
  3. Image titled Conduct a Pilot Study Step 7
    3
    Use methods as rigorous as those in the full study. Using the same methodology as you intend to use for the full study allows you to evaluate whether you can do the full study. If, on the other hand, you take short cuts in the pilot study, you won't have any usable information that you can apply to the full study.[8]
    • For example, if your full study will be double-blind, your pilot should also have double-blind procedures in place. While this might make your pilot a little more expensive, it's the only way to accurately test the feasibility of the full study.
    • If you're trying to figure out if you'll retain participants throughout the course of the full study, the pilot study should take just as long as the full study is planned to take.[9]
    4. Advertisement
Part 3
Part 3 of 3:

Implementing Your Findings

  1. Image titled Conduct a Pilot Study Step 8
    1
    Interview participants about their experience in the pilot study. Talking to the participants after the pilot study is over gives you valuable information about your methodology. Participants can point out issues that you might've overlooked if you only considered things from a researcher's perspective.[10]
    • For example, if you had a pilot study to determine if you could retain participants through the end of the study, you might give exit interviews with participants who left the study to find out why they left. You could then use that information to adjust the full study for greater retention of participants.
    • In addition to formal interviews after the study, you or other researchers working with you can ask participants questions during the study and encourage them to speak up when they have a problem or if there's something they don't understand.
    • Instructions or questions that might seem clear to you can be confusing for participants. Talking to participants about their experience can help you identify areas where your instructions or questions could be clarified.
  2. Image titled Conduct a Pilot Study Step 9
    2
    Modify the full study's methodology based on the pilot study. The findings from your pilot study tell you whether the methodology you originally planned for the full study is feasible. If the methods didn't work in the pilot study, they likely won't work for the full study unless they're changed.[11]
    • For example, if your question was retention of participants and fewer than half of your participants stayed through the end of the pilot study, you would need to modify the full study to make it more likely for participants to stay. You could also expand the full study to include more participants with the understanding that at least half of them would drop out.
    • Information you gained from the pilot study may require you to completely redesign your methodology for the full study. If you change the methodology to a significant extent, you may need a second pilot study to evaluate the revised methodology.
  3. Image titled Conduct a Pilot Study Step 10
    3
    Incorporate your results into the full study if you didn't find any problems. Sometimes, a pilot study reveals that the methodology for your full study is sound and workable. If you don't have to change anything about the protocol for the full study, the pilot study simply gives you a jump-start on the full study.[12]
    • If your pilot study sample didn't cover the entire range anticipated for your full study, you'll need to adjust your full study sample to correct for the bias in your pilot study sample. Otherwise, your final results will be skewed.
    4. Advertisement

Warnings

  • Don't label your study as a "pilot study" to justify a small or inadequate sample size. A true pilot study is conducted to determine feasibility before undertaking the time and expense of a full study.[15]
    ⧼thumbs_response⧽
Advertisement

You Might Also Like

Make Distilled WaterHow to Make Distilled Water
Check Water Temperature Without a Thermometer
How to
Check Water Temperature Without a Thermometer
How to
Create a School Project on the Layers of the Earth
Spot Fake Gold
How to
Spot Fake Gold
Avoid (Static) Electric Shock
How to
Avoid (Static) Electric Shock
Calculate Distance
How to
Calculate Distance
Soften Rubber
How to
Soften Rubber
Become a Scientist
How to
Become a Scientist
Find Spring ConstantCalculate the Spring Constant Using Hooke’s Law: Formula, Examples, and Practice Problems
Study for a Science Exam
How to
Study for a Science Exam
Create Agar
How to
Create Agar
Prepare Glycerol Stock
How to
Prepare Glycerol Stock
Make a Hologram
How to
Make a Hologram
Develop a Theory
How to
Develop a Theory
Advertisement

References

  1. ↑ https://www.americangeriatrics.org/sites/default/files/inline-files/essentials_pilot_study.pdf
  2. ↑ https://www.americangeriatrics.org/sites/default/files/inline-files/essentials_pilot_study.pdf
  3. ↑ https://www.nccih.nih.gov/grants/pilot-studies-common-uses-and-misuses
  4. ↑ https://www.students4bestevidence.net/blog/2017/07/31/pilot-studies/
  5. ↑ http://dissertationrecipes.com/wp-content/uploads/2011/04/Conducting-Pilot-Studies.pdf
  6. ↑ https://sru.soc.surrey.ac.uk/SRU35.html
  7. ↑ http://dissertationrecipes.com/wp-content/uploads/2011/04/Conducting-Pilot-Studies.pdf
  8. ↑ https://www.americangeriatrics.org/sites/default/files/inline-files/essentials_pilot_study.pdf
  9. ↑ https://www.nccih.nih.gov/grants/pilot-studies-common-uses-and-misuses
  1. ↑ https://www.nngroup.com/articles/pilot-testing/
  2. ↑ https://www.nc3rs.org.uk/conducting-pilot-study
  3. ↑ https://www.nc3rs.org.uk/conducting-pilot-study
  4. ↑ https://sru.soc.surrey.ac.uk/SRU35.html
  5. ↑ https://grants.nih.gov/grants/funding/funding_program.htm
  6. ↑ https://www.americangeriatrics.org/sites/default/files/inline-files/essentials_pilot_study.pdf

About This Article

Jennifer Mueller, JD
Co-authored by:
Jennifer Mueller, JD
Doctor of Law, Indiana University
This article was co-authored by wikiHow staff writer, Jennifer Mueller, JD. Jennifer Mueller is a wikiHow Content Creator. She specializes in reviewing, fact-checking, and evaluating wikiHow's content to ensure thoroughness and accuracy. Jennifer holds a JD from Indiana University Maurer School of Law in 2006. This article has been viewed 13,266 times.
4 votes - 100%
Co-authors: 2
Updated: July 20, 2020
Views: 13,266
Categories: Science
Advertisement