Journal of Clinical Epidemiology
Volume 58, Issue 6 , Pages 550-559 , June 2005

Propensity score methods gave similar results to traditional regression modeling in observational studies: a systematic review

  • Baiju R. Shah

      Affiliations

    • Institute for Clinical Evaluative Sciences, G106 – 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada
    • Department of Medicine and Clinical Epidemiology and Health Care Research Program, University of Toronto, Ontario, Canada
    • Corresponding Author InformationCorresponding author. Tel.: 416-480-4055 ext. 3798; fax: 416-480-6048.
  • ,
  • Andreas Laupacis

      Affiliations

    • Institute for Clinical Evaluative Sciences, G106 – 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada
    • Department of Medicine and Clinical Epidemiology and Health Care Research Program, University of Toronto, Ontario, Canada
  • ,
  • Janet E. Hux

      Affiliations

    • Institute for Clinical Evaluative Sciences, G106 – 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada
    • Department of Medicine and Clinical Epidemiology and Health Care Research Program, University of Toronto, Ontario, Canada
  • ,
  • Peter C. Austin

      Affiliations

    • Institute for Clinical Evaluative Sciences, G106 – 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada
    • Department of Public Health Sciences, University of Toronto, Ontario, Canada

,Accepted 20 October 2004.

References 

  1. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70:41–55
  2. Rosenbaum PR, Rubin DB. Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcome. J R Stat Soc. 1983;45:212–218
  3. Abramov D, Tamariz M, Serrick CI, Sharp E, Noel D, Harwood S, et al. The influence of cardiopulmonary bypass flow characteristics on the clinical outcome of 1820 coronary bypass patients. Can J Cardiol. 2003;19:237–243
  4. Aronow HD, Topol EJ, Roe MT, Houghtaling PL, Wolski KE, Lincoff AM, et al. Effect of lipid-lowering therapy on early mortality after acute coronary syndromes: an observational study. Lancet. 2001;357:1063–1068
  5. Barosi G, Ambrosetti A, Centra A, Falcone A, Finelli C, Foa P, et al. Splenectomy and risk of blast transformation in myelofibrosis with myeloid metaplasia. Blood. 1998;91:3630–3636
  6. Chan AW, Quinn MJ, Bhatt DL, Chew DP, Moliterno DJ, Topol EJ, et al. Mortality benefit of beta-blockade after successful elective percutaneous coronary intervention. J Am Coll Cardiol. 2002;40:669–675
  7. Chan AW, Bhatt DL, Chew DP, Quinn MJ, Moliterno DJ, Topol EJ, et al. Early and sustained survival benefit associated with statin therapy at the time of percutaneous coronary intervention. Circulation. 2002;105:691–696
  8. Cook EF, Goldman L. Performance of tests of significance based on stratification by a multivariate confounder score or by a propensity score. J Clin Epidemiol. 1989;42:317–324
  9. Drake C, Fisher L. Prognostic models and the propensity score. Int J Epidemiol. 1995;24:183–187
  10. Earle CC, Tsai JS, Gelber RD, Weinstein MC, Neumann PJ, Weeks JC. Effectiveness of chemotherapy for advanced lung cancer in the elderly: instrumental variable and propensity analysis. J Clin Oncol. 2001;19:1064–1070
  11. Elad Y, French WJ, Shavelle DM, Parsons LS, Sada MJ, Every NR. Primary angioplasty and selection bias inpatients presenting late (>12 h) after onset of chest pain and ST elevation myocardial infarction. J Am Coll Cardiol. 2002;39:826–833
  12. Ferguson TB, Coombs LP, Peterson ED. Internal thoracic artery grafting in the elderly patient undergoing coronary artery bypass grafting: room for process improvement?. J Thorac Cardiovasc Surg. 2002;123:869–880
  13. Ferguson TB, Coombs LP, Peterson ED, Society of Thoracic Surgeons National Adult Cardiac Surgery Database . Preoperative beta-blocker use and mortality and morbidity following CABG surgery in North America. JAMA. 2002;287:2221–2227[Erratum in: JAMA 2002;287:3212]
  14. Flameng WJ, Herijgers P, Dewilde S, Lesaffre E. Continuous retrograde blood cardioplegia is associated with lower hospital mortality after heart valve surgery. J Thorac Cardiovasc Surg. 2003;125:121–125
  15. Foody JM, Cole CR, Blackstone EH, Lauer MS. A propensity analysis of cigarette smoking and mortality with consideration of the effects of alcohol. Am J Cardiol. 2001;87:706–711
  16. Grunkemeier GL, Payne N, Jin R, Handy JR. Propensity score analysis of stroke after off-pump coronary artery bypass grafting. Ann Thorac Surg. 2002;74:301–305
  17. Gum PA, Thamilarasan M, Watanabe J, Blackstone EH, Lauer MS. Aspirin use and all-cause mortality among patients being evaluated for known or suspected coronary artery disease: a propensity analysis. JAMA. 2001;286:1187–1194
  18. Gurm HS, Lauer MS. Predicting incidence of some critical events by sun signs: The PISCES study. ACC Curr J Rev. 2003;12:22–24
  19. Hak E, Hoes AW, Grobbee DE, Lammers JW, van Essen GA, van Loon AM, et al. Conventional influenza vaccination is not associated with complications in working-age patients with asthma or chronic obstructive pulmonary disease. Am J Epidemiol. 2003;157:692–700
  20. Ioannidis JP, Galanos O, Katritsis D, Connery CP, Drossos GE, Swistel DG, et al. Early mortality and morbidity of bilateral versus single internal thoracic artery revascularization: propensity and risk modeling. J Am Coll Cardiol. 2001;37:521–528
  21. Katzan IL, Cebul RD, Husak SH, Dawson NV, Baker DW. The effect of pneumonia on mortality among patients hospitalized for acute stroke. Neurology. 2003;60:620–625
  22. Magee MJ, Jablonski KA, Stamou SC, Pfister AJ, Dewey TM, Dullum MK, et al. Elimination of cardiopulmonary bypass improves early survival for multivessel coronary artery bypass patients. Ann Thorac Surg. 2002;73:1196–1202
  23. Mehta RL, McDonald B, Gabbai F, Pahl M, Farkas A, Pascual MT, et al. Nephrology consultation in acute renal failure: does timing matter?. Am J Med. 2002;113:456–461
  24. Mehta RL, Pascual MT, Soroko S, Chertow GM, PICARD Study Group . Diuretics, mortality, and nonrecovery of renal function in acute renal failure. JAMA. 2002;288:2547–2553
  25. Moazami N, Rice TW, Rybicki LA, Adelstein DJ, Murthy SC, DeCamp MM, et al. Stage III non-small cell lung cancer and metachronous brain metastases. J Thorac Cardiovasc Surg. 2002;124:113–122
  26. Myers WO, Gersh BJ, Fisher LD, Mock MB, Holmes DR, Schaff HV, et al. Coronary Artery Surgery Study. Time to first new myocardial infarction in patients with mild angina and three-vessel disease comparing medicine and early surgery: a CASS registry study of survival. Ann Thorac Surg. 1987;43:599–612
  27. Nakamura Y, Moss AJ, Brown MW, Kinoshita M, Kawai C, Multicenter Myocardial Ischemia Research Group . Long-term nitrate use may be deleterious in ischemic heart disease: a study using the databases from two large-scale postinfarction studies. Am Heart J. 1999;138:577–585
  28. Neugut AI, Fleischauer AT, Sundararajan V, Mitra N, Heitjan DF, Jacobson JS, et al. Use of adjuvant chemotherapy and radiation therapy for rectal cancer among the elderly: a population-based study. J Clin Oncol. 2002;20:2643–2650
  29. Newby LK, Kristinsson A, Bhapkar MV, Aylward PE, Dimas AP, Klein WW, et al. Sibrafiban vs Aspirin to Yield Maximun Protection From Ischemic Heart Events Post-acute Coronary Syndromes. Early statin initiation and outcomes in patients with acute coronary syndromes. JAMA. 2002;287:3087–3095
  30. Osswald BR, Blackstone EH, Tochtermann U, Schweiger P, Thomas G, Vahl CF, et al. Does the completeness of revascularization affect early survival after coronary artery bypass grafting in elderly patients?. Eur J Cardio-Thorac. 2001;20:120–125
  31. Patel U, Spitznagel E, Piccirillo J. Multivariate analyses to assess treatment effectiveness in advanced head and neck cancer. Arch Otolaryngol Head Neck Surg. 2002;128:497–503
  32. Posner MA, Ash AS, Freund KM, Moskowitz MA, Schwartz M. Comparing standard regression, propensity score matching, and instrumental variables methods for determining the influence of mammography on stage of diagnosis. Health Serv Outcomes Res Methodol. 2001;2:279–290
  33. Regueiro CR, Hamel MB, Davis RB, Desbiens N, Connors AF, Phillips RS, et al. Study to Understand Prognoses and Preferences for Outcomes and Risks of Treatment. A comparison of generalist and pulmonologist care for patients hospitalized with severe chronic obstructive pulmonary disease: resource intensity, hospital costs, and survival. Am J Med. 1998;105:366–372
  34. Shavelle DM, Parsons L, Sada MJ, French WJ, Every NR. National Registry of Myocardial Infarction 2. Is there a benefit to early angiography in patients with ST-segment depression myocardial infarction? An observational study. Am Heart J. 2002;143:488–496
  35. Shishehbor MH, Baker DW, Blackstone EH, Lauer MS. Association of educational status with heart rate recovery: a population-based propensity analysis. Am J Med. 2002;113:643–649
  36. Stamou SC, Jablonski KA, Pfister AJ, Hill PC, Dullum MK, Bafi AS, et al. Stroke after conventional versus minimally invasive coronary artery bypass. Ann Thorac Surg. 2002;74:394–399
  37. Stenestrand U, Wallentin L. Early revascularisation and 1-year survival in 14-day survivors of acute myocardial infarction: a prospective cohort study. Lancet. 2002;359:1805–1811
  38. Stenestrand U, Wallentin L. Register of Information and Knowledge About Swedish Heart Intensive Care Admissions (RIKS-HIA). Fibrinolytic therapy in patients 75 years and older with ST-segment-elevation myocardial infarction: one-year follow-up of a large prospective cohort. Arch Intern Med. 2003;163:965–971
  39. Stenestrand U, Wallentin L. Swedish Register of Cardiac Intensive Care (RIKS-HIA). Early statin treatment following acute myocardial infarction and 1-year survival. JAMA. 2001;285:430–436
  40. Teufelsbauer H, Prusa AM, Wolff K, Polterauer P, Nanobashvili J, Prager M, et al. Endovascular stent grafting versus open surgical operation in patients with infrarenal aortic aneurysms: a propensity score-adjusted analysis. Circulation. 2002;106:782–787
  41. Winkelmayer WC, Glynn RJ, Mittleman MA, Levin R, Pliskin JS, Avorn J. Comparing mortality of elderly patients on hemodialysis versus peritoneal dialysis: a propensity score approach. J Am Soc Nephrol. 2002;13:2353–2362
  42. Winkelmayer WC, Owen WF, Levin R, Avorn J. A propensity analysis of late versus early nephrologist referral and mortality on dialysis. J Am Soc Nephrol. 2003;14:486–492
  43. Hayashi K, Hasegawa K, Kobayashi S. Effects of angiotensin-converting enzyme inhibitors on the treatment of anemia with erythropoietin. Kidney Int. 2001;60:1910–1916
  44. Jenkins NP, Keevil BG, Hutchinson IV, Brooks NH. Beta-blockers are associated with lower C-reactive protein concentrations in patients with coronary artery disease. Am J Med. 2002;112:269–274
  45. Polsky D, Mandelblatt JS, Weeks JC, Venditti L, Hwang YT, Glick HA, et al. Economic evaluation of breast cancer treatment: considering the value of patient choice. J Clin Oncol. 2003;21:1139–1146
  46. Braitman LE, Rosenbaum PR. Rare outcomes, common treatments: analytic strategies using propensity scores. Ann Intern Med. 2002;137:693–695
  47. Weitzen S, Lapane KL, Toledano AY, Hume AL, Mor V. Principles for modeling propensity scores in medical research: a systematic literature review. Pharmacoepidemiol Drug Saf. 2004;13:841–853
  48. Cepeda MS, Boston R, Farrar JT, Strom BL. Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders. Am J Epidemiol. 2003;158:280–287
  49. Rosenbaum PR, Rubin DB. Reducing bias in observational studies using subclassification on the propensity score. J Am Stat Assoc. 1984;79:516–524
  50. Rubin DB. Estimating causal effects from large data sets using propensity scores. Ann Intern Med. 1997;127:757–763

PII: S0895-4356(04)00323-3

doi: 10.1016/j.jclinepi.2004.10.016

Journal of Clinical Epidemiology
Volume 58, Issue 6 , Pages 550-559 , June 2005