Meta-analysis: Difference between revisions
imported>Robert Badgett |
imported>Robert Badgett (→Factors associated with lower quality meta-analyses: Started section "Outcome reporting bias") |
||
Line 19: | Line 19: | ||
In performing a [[meta-analysis|meta-analyses]], a file drawer<ref name="pmid11523382">{{cite journal |author=Pham B ''et al.'' |title=Is there a "best" way to detect and minimize publication bias? An empirical evaluation |journal=Evaluation & the Health Professions |volume=24 |pages=109–25 |year=2001 |pmid=11523382 |doi=}}</ref> or a funnel plot analysis<ref name="pmid9310563">{{cite journal |author=Egger M ''et al.'' |title=Bias in meta-analysis detected by a simple, graphical test |journal=BMJ |volume=315 |pages=629–34 |year=1997 |pmid=9310563 |doi=}}</ref><ref name="pmid16085192">{{cite journal |author=Terrin N ''et al.'' |title=In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias |journal=J Clin Epidemiol |volume=58 |pages=894–901 |year=2005 |pmid=16085192 |doi=10.1016/j.jclinepi.2005.01.006}}</ref> may help detect underlying publication bias among the studies in the meta-analysis. | In performing a [[meta-analysis|meta-analyses]], a file drawer<ref name="pmid11523382">{{cite journal |author=Pham B ''et al.'' |title=Is there a "best" way to detect and minimize publication bias? An empirical evaluation |journal=Evaluation & the Health Professions |volume=24 |pages=109–25 |year=2001 |pmid=11523382 |doi=}}</ref> or a funnel plot analysis<ref name="pmid9310563">{{cite journal |author=Egger M ''et al.'' |title=Bias in meta-analysis detected by a simple, graphical test |journal=BMJ |volume=315 |pages=629–34 |year=1997 |pmid=9310563 |doi=}}</ref><ref name="pmid16085192">{{cite journal |author=Terrin N ''et al.'' |title=In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias |journal=J Clin Epidemiol |volume=58 |pages=894–901 |year=2005 |pmid=16085192 |doi=10.1016/j.jclinepi.2005.01.006}}</ref> may help detect underlying publication bias among the studies in the meta-analysis. | ||
===Outcome reporting bias=== | |||
Meta-analyses in which a smaller proportion of included trials provide raw data for inclusion in the meta-analysis are more likely to be positive.<ref name="pmid17284696">{{cite journal |author=Furukawa TA, Watanabe N, Omori IM, Montori VM, Guyatt GH |title=Association between unreported outcomes and effect size estimates in Cochrane meta-analyses |journal=JAMA |volume=297 |issue=5 |pages=468–70 |year=2007 |month=February |pmid=17284696 |doi=10.1001/jama.297.5.468-b |url=http://jama.ama-assn.org/cgi/pmidlookup?view=long&pmid=17284696 |issn=}}</ref> This may be due a bias against reporting negative results.<ref name="pmid15161896">{{cite journal |author=Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG |title=Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles |journal=JAMA |volume=291 |issue=20 |pages=2457–65 |year=2004 |month=May |pmid=15161896 |doi=10.1001/jama.291.20.2457 |url=http://jama.ama-assn.org/cgi/pmidlookup?view=long&pmid=15161896 |issn=}}</ref> | |||
==References== | ==References== | ||
<references/> | <references/> |
Revision as of 08:09, 16 May 2008
Meta-analysis is defined as "a quantitative method of combining the results of independent studies (usually drawn from the published literature) and synthesizing summaries and conclusions which may be used to evaluate therapeutic effectiveness, plan new studies, etc., with application chiefly in the areas of research and medicine."[1]
A meta-analyses is a subset of systematic reviews in which the results of the studies are numerically pooled.
Factors associated with higher quality meta-analyses
Meta-analyses by the Cochrane Collaboration tend to be of higher quality.[2]
Individual data meta-analyses, in which the records from individual patients are pooled together into one dataset, tend to have more stable conclusions.[3]
Factors associated with lower quality meta-analyses
About a third of meta-analyses that happen to precede large randomized controlled trials will conflict with the results of the trial.[4]
Conflict of interest
Meta-analyses produced with a conflict of interest are more likely to interpret results as positive.[5]
Publication bias
Publication bias against negative studies may threaten the validity of meta-analyses that are positive and all the studies included within the meta-analysis are small.[6][7]
In performing a meta-analyses, a file drawer[8] or a funnel plot analysis[7][9] may help detect underlying publication bias among the studies in the meta-analysis.
Outcome reporting bias
Meta-analyses in which a smaller proportion of included trials provide raw data for inclusion in the meta-analysis are more likely to be positive.[10] This may be due a bias against reporting negative results.[11]
References
- ↑ National Library of Medicine. Meta-analysis. Retrieved on 2007-12-06.
- ↑ Olsen O, Middleton P, Ezzo J, et al (2001). "Quality of Cochrane reviews: assessment of sample from 1998". BMJ 323 (7317): 829–32. PMID 11597965. [e]
- ↑ Poynard T, Munteanu M, Ratziu V, et al (2002). "Truth survival in clinical research: an evidence-based requiem?". Ann. Intern. Med. 136 (12): 888–95. PMID 12069563. [e]
- ↑ LeLorier J, Grégoire G, Benhaddad A, Lapierre J, Derderian F (1997). "Discrepancies between meta-analyses and subsequent large randomized, controlled trials". N. Engl. J. Med. 337 (8): 536–42. PMID 9262498. [e]
- ↑ Veronica Yank, Drummond Rennie, and Lisa A Bero, “Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study,” BMJ 335, no. 7631 (December 8, 2007), http://www.bmj.com/cgi/content/abstract/335/7631/1202 (accessed December 7, 2007).
- ↑ Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR (2000). "Empirical assessment of effect of publication bias on meta-analyses". BMJ 320 (7249): 1574–7. PMID 10845965. [e]
- ↑ 7.0 7.1 Egger M, Davey Smith G, Schneider M, Minder C (1997). "Bias in meta-analysis detected by a simple, graphical test". BMJ 315 (7109): 629–34. PMID 9310563. [e]
Cite error: Invalid
<ref>
tag; name "pmid9310563" defined multiple times with different content - ↑ Pham B et al. (2001). "Is there a "best" way to detect and minimize publication bias? An empirical evaluation". Evaluation & the Health Professions 24: 109–25. PMID 11523382. [e]
- ↑ Terrin N et al. (2005). "In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias". J Clin Epidemiol 58: 894–901. DOI:10.1016/j.jclinepi.2005.01.006. PMID 16085192. Research Blogging.
- ↑ Furukawa TA, Watanabe N, Omori IM, Montori VM, Guyatt GH (February 2007). "Association between unreported outcomes and effect size estimates in Cochrane meta-analyses". JAMA 297 (5): 468–70. DOI:10.1001/jama.297.5.468-b. PMID 17284696. Research Blogging.
- ↑ Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG (May 2004). "Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles". JAMA 291 (20): 2457–65. DOI:10.1001/jama.291.20.2457. PMID 15161896. Research Blogging.