Advertisement
Original article| Volume 50, ISSUE 10, P1129-1136, October 1997

Response rates to mail surveys published in medical journals

  • David A. Asch
    Correspondence
    Address for correspondence: David A. Asch, M.D., Division of General Internal Medicine, 317 Ralston-Penn Center, 3615 Chestnut Street, Philadelphia, PA 19104-2676.
    Footnotes
    Affiliations
    Veterans Affairs Medical Center, Philadelphia, Pennsylvania 19104 USA

    Division of General Internal Medicine, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania 19104-2676 USA
    Search for articles by this author
  • M.Kathryn Jedrziewski
    Affiliations
    Division of General Internal Medicine, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania 19104-2676 USA
    Search for articles by this author
  • Nicholas A. Christakis
    Correspondence
    Address for reprint requests: Nicholas A. Christakis, M.D., Division of General Internal Medicine, University of Chicago Medical Center, 5841 S. Maryland Avenue—MC 6098, Chicago, IL 60637.
    Footnotes
    Affiliations
    Section of General Internal Medicine, University of Chicago, Chicago, Illinois 60637 USA

    Department of Sociology, University of Chicago, Chicago, Illinois 60637 USA
    Search for articles by this author
  • Author Footnotes
    1 Dr. Asch is the recipient of a Department of Veterans Affairs Health Services Research and Development Service Career Development Award.
    2 Dr. Christakis was the recipient of a NRSA Fellowship from the Agency for Health Case Policy and Research.
      This paper is only available as a PDF. To read, Please Download here.

      Abstract

      Objective. The purpose of this study was to characterize response rates for mail surveys published in medical journals; to determine how the response rate among subjects who are typical targets of mail surveys varies; and to evaluate the contribution of several techniques used by investigators to enhance response rates. Methods. One hundred seventy-eight manuscripts published in 1991, representing 321 distinct mail surveys, were abstracted to determine response rates and survey techniques. In a follow-up mail survey, 113 authors of these manuscripts provided supplementary information. Results. The mean response rate among mail surveys published in medical journals is approximately 60%. However, response rates vary according to subject studied and techniques used. Published surveys of physicians have a mean response rate of only 54%, and those of non-physicians have a mean response rate of 68%. In addition, multivariable models suggest that written reminders provided with a copy of the instrument and telephone reminders are each associated with response rates about 13% higher than surveys that do not use these techniques. Other techniques, such as anonymity and financial incentives, are not associated with higher response rates. Conclusions. Although several mail survey techniques are associated with higher response rates, response rates to published mail surveys tend to be moderate. However, a survey's response rate is at best an indirect indication of the extent of non-respondent bias. Investigators, journal editors, and readers should devote more attention to assessments of bias, and less to specific response rate thresholds.

      Keywords

      References

        • Cohen J
        • Cohen P
        Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, Hillsdale, NJ1975
        • Fox RJ
        • Crask MR
        • Kim J
        Mail survey response rate: A metaanalysis of selected techniques for inducing response.
        Public Opinion Quarterly. 1989; 52: 467-491
        • Camuñas C
        • Alward RR
        • Vecchione E
        Survey response rates to a professional association mail questionnaire.
        J NY State Nurses Assoc. 1990; 21: 7-9
        • Church AH
        Estimating the effect of incentives on mail survey response rates: A meta-analysis.
        Public Opinion Quarterly. 1993; 57: 62-79
        • Rimm EB
        • Stampfer MJ
        • Colditz GA
        • Giovannucci E
        • Willett WC
        Effectiveness of various mailing strategies among nonrespondents in a prospective cohort study.
        Am J Epidemiol. 1990; 131: 1068-1071
        • Choi BCK
        • Pack AWP
        • Purdham JT
        Effects of mailing strategies on response rate, response time, and cost in a questionnaire study among nurses.
        Epidemiology. 1990; 1: 72-74
        • Shiono PH
        • Klebanoff
        The effect of two mailing strategies on the response to a survey of physicians.
        Am J Epidemiol. 1991; 134: 539-542
        • Asch DA
        • Christakis NA
        Different response rates in a trial of two envelope styles in mail survey research.
        Epidemiology. 1994; 5: 364-365
        • Berry SH
        • Kanouse DE
        Physician response to a mailed survey: An experiment in timing of payment.
        Public Opinion Quarterly. 1987; 51: 102-114
        • Weiss LI
        • Freidman D
        • Shoemaker CL
        Prepaid incentives yield higher response rates to mail surveys.
        Marketing News. 1985; 19: 30-31
        • Schweitzer M
        • Asch DA
        Timing payments to subjects of mail surveys: Cost-effectiveness and bias.
        J Clin Epidemiol. 1995; 48: 1325-1329
        • Fox RJ
        • Crask MR
        • Kim J
        Mail survey response rate: A meta-analysis of selected techniques for inducing response.
        Public Opinion Quarterly. 1989; 52: 467-491
        • Yammarino FJ
        • Skinner SJ
        • Childers TL
        Understanding mail survey response behavior: A meta-analysis.
        Public Opinion Quarterly. 1991; 55: 613-639
        • Yu J
        • Cooper H
        A quantitative review of research design effects on response rates to questionnaires.
        J Marketing Res. 1983; 20: 36-44
        • Armstrong JS
        • Lusk EJ
        Return postage in mail surveys, A meta-analysis.
        Public Opinion Quarterly. 1987; 51: 233-248
        • Yammarino FJ
        • Skinner SJ
        • Cuilders TL
        Understanding mail survey response behavior: A meta-analysis.
        Public Opinion Quarterly. 1991; 55: 613-639
        • Yu J
        • Cooper H
        A quantitative review of research design effects on response rates to questionnaires.
        J Marketing Res. 1983; 20: 36-44
        • Church AH
        Estimating the effect of incentives on mail survey response rates: A meta-analysis.
        Public Opinion Quarterly. 1993; 57: 62-79
        • James JM
        • Bolstein R
        Large monetary incentives and their effect on mail survey response rates.
        Public Opinion Quarterly. 1992; 56: 442-453
        • Mizes S
        • Fleece L
        • Roos C
        Incentives for increasing return rates: Magnitude levels, response bias, and format.
        Public Opinion Quarterly. 1984; 48: 794-800
        • Aday LA
        Designing and Conducting Health Surveys. Jossey-Bass, San Francisco1989
        • Groves RM
        • Cialdini RB
        • Couper MP
        Understanding the decision to participate in a survey.
        Public Opinion Quarterly. 1992; 56: 475-495
        • Brennan M
        • Hoek J
        The behavior of respondents, nonrespondents, and refusers across mail surveys.
        Public Opinion Quarterly. 1992; 56: 530-535