|
Sign In to gain access to subscriptions and/or personal tools.
|
Markov Chain Monte Carlo Estimation of a Multiparameter Decision Model: Consistency of Evidence and the Accurate Assessment of Uncertainty
A. E. Ades, PhD
Medical Research Council, Health Services Research Collaboration, University of Bristol, Bristol, United Kingdom
S. Cliffe, MPH
Communicable Disease Surveillance Centre, Public Health Laboratory Service, Colindale, United Kingdom, and the Department of Epidemiology and Biostatistics, Institute of Child Health, University College London, London, United Kingdom
Decision models are usually populated 1 parameter at a time, with 1 item of information informing each parameter. Often, however, data may not be available on the parameters themselves but on several functions of parameters, and there may be more items of information than there are parameters to be estimated. The authors show how in these circumstances all the model parameters can be estimated simultaneously using Bayesian Markov chain Monte Carlo methods. Consistency of the information and/or the adequacy of the model can also be assessed within this framework. Statistical evidence synthesis using all available data should result in more precise estimates of parameters and functions of parameters, and is compatible with the emphasis currently placed on systematic use of evidence. To illustrate this, WinBUGS software is used to estimate a simple 9-parameter model of the epidemiology of HIV in women attending prenatal clinics, using information on 12 functions of parameters, and to thereby compute the expected net benefit of 2 alternative prenatal testing strategies, universal testing and targeted testing of high-risk groups. The authors demonstrate improved precision of estimates, and lower estimates of the expected value of perfect information, resulting from the use of all available data.
Key Words: evidence synthesis • decision analysis • Markov chain Monte Carlo • Bayesian methods • incremental net benefit • expected value of perfect information • epidemiology • HIV • screening
References
- Naglie G, Krahn MD, Naimark D, Redelmeier DA, Detsky AS. Primer on medical decision analysis: part 3—estimating probabilities and utilities. Med Decis Making. 1997;17:136-141.[Abstract/Free Full Text]
- Petitti DB. Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis: Methods for Quantitative Synthesis in Medicine. New York: Oxford University Press, 2000.
- Doubilet P, Begg CB, Weinstein MC, Braun P, McNeill BJ. Probabilistic sensitivity analysis using Monte Carlo simulation: a practical approach. Med Decis Making. 1985;5:157-177.[Free Full Text]
- Critchfield GC, Willard KE. Probabilistic analysis of decision trees using Monte Carlo simulation. Med Decis Making. 1986;6:85-92.[Abstract/Free Full Text]
- Thompson KM, Burmaster DE, Crouch EAC. Monte Carlo techniques for quantitative uncertainty analysis in public health risk assessments. Risk Anal. 1992;12:53-63.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Manning WG, Fryback DG, Weinstein MC. Reflecting uncertainty in decision analysis. In: Gold MR, Siegel JE, Russell LB, Weinstein MC, eds. Cost-Effectiveness in Health and Medicine. New York: Oxford University Press, 1996. p. 247-275.
- Eddy DM, Hasselblad V, Shachter R. Meta-Analysis by the Confidence Profile Method. London: Academic Press, 1992.
- Eddy DM, Hasselblad V, Shachter R. An introduction to a Bayesian method for meta-analysis: the confidence profile method. Med Decis Making. 1990;10:15-23.[Abstract/Free Full Text]
- Eddy DM, Hasselblad V, Shachter R. A Bayesian method for synthesising evidence: the confidence profile method. Int J Technol Assess Health Care 1990;6:31-35.[Medline]
[Order article via Infotrieve]
- Eddy DM. The confidence profile method: a Bayesian method for assessing health technologies. Operations Res. 1989;37:210-228.[Abstract/Free Full Text]
- Shachter R, Eddy DM, Hasselblad V. An influence diagram approach to medical technology assessment. In: Oliver RM, Smith JQ, eds. Influence Diagrams, Belief Nets and Decision Analysis. New York: John Wiley, 1990. p. 321-350.
- Spiegelhalter DJ, Thomas A, Best N. WinBUGS User Manual (1.3). Cambridge, UK: MRC Biostatistics Unit, 2000.
- Ades AE, Sculpher MJ, Gibb DM, Gupta R, Ratcliffe J. Cost effectiveness analysis of antenatal HIV screening in United Kingdom. Br Med J. 1999;319:1230-1234.[Abstract/Free Full Text]
- Ades AE, Gupta R, Gibb DM, et al. Selective versus universal antenatal HIV testing: epidemiological and implementational factors in policy choice. Aids. 1999;13:271-278.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Ades AE, Sculpher MJ, Gibb D, Ratcliffe J, Gupta R. A cost-effectiveness analysis of antenatal HIV testing in the UK. Health Economics Research Group Research Report no. 26, Brunel University, Middlesex, UK, 1999.
- Ades AE, Ratcliffe J, Gibb DM, Sculpher MJ. Economic issues in the prevention of vertical transmission of HIV. Pharmacoeconomics. 2000;18:9-22.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Office for National Statistics. Reducing the Odds: Preventing Perinatal Transmission of HIV in the United States. Washington, DC: National Academy Press, 1999.
- Office for National Statistics. Birth Statistics, 1999. London: The Stationary Office, 2000.
- Johnson AM, Wadsworth J, Wellings K, Field J. Sexual attitudes and lifestyles. Oxford, UK: Blackwell Scientific, 1994.
- Ades AE, Walker J, Botting B, Parker S, Cubitt D, Jones R. Effect of the worldwide epidemic on HIV prevalence in the United Kingdom: record linkage in anonymous neonatal seroprevalence surveys. Aids. 1999;13:2437-2443.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Public Health Laboratory Service, Institute of Child Health, and Scottish Centre for Infection and Environmental Health. Unlinked Anonymous Prevalence Monitoring Programme: Annual Report Supplementary Data Set: Data to End of 1999. Colindale, UK: Public Health Laboratory Service, 2000.
- Ades AE, Davison CF, Holland FJ, et al. Vertically transmitted HIV infection in the British Isles. Br Med J. 1993;306:1296-1299.[Abstract/Free Full Text]
- Nicoll A, McGarrigle C, Brady AR, et al. Epidemiology and detection of HIV-1 among pregnant women in the United Kingdom: results from national surveillance 1988-96. Br Med J. 1998;316:253-258.[Abstract/Free Full Text]
- Holland FJ, Ades AE, Davison C, et al. Use of anonymous newborn serosurveys to evaluate antenatal HIV screening programmes. J Med Screening 1994;1:176-179.[Medline]
[Order article via Infotrieve]
- Hu DJ, Dondero TJ, Rayfield MA, et al. The emerging genetic diversity of HIV: the importance of global surveillance for diagnostics, research, and prevention. JAMA. 1996;275:210-216.[Abstract/Free Full Text]
- Ades AE, Parker S, Walker J, Weber JN. Serotype, parental country of birth, and ethnic status in unlinked anonymous neonatal HIV seroprevalence surveys. J AIDS. 2000;24:292-294.
- Zeuner D, Ades AE, Karnon J, Brown J, Dezateux C, Anionwu AN. Antenatal and neonatal haemoglobinopathy screening in the UK: review and economic analysis. Health Technol Assess. 1999;3:1-183.[Medline]
[Order article via Infotrieve]
- Claxton K, Posnett J. An economic approach to clinical trial design and research priority-setting. Health Econ. 1996;5:513-524.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Stinnett A, Mullahy J. Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analyses. Med Decis Making. 1998;18:S68-S80.[Abstract/Free Full Text]
- Department of Health. Register of Cost-Effectiveness Studies. London: Department of Health, 1995.
- Raiffa H. Decision Analysis: Introductory Lectures on Choices under Uncertainty. Reading, MA: Addison-Wesley, 1961.
- Schlaiffer R. Probability and Statistics for Business Decisions. New York: McGraw-Hill, 1958.
- Gilks WR, Richardson S, Spiegelhalter DJ. Markov Chain Monte Carlo in Practice. London: Chapman & Hall/CRC, 1996.
- Carlin JG, Louis TA. Bayes and Empirical Bayes Methods for Data Analysis. Boca Raton, FL: Chapman & Hall/CRC, 2000.
- Congdon P. Bayesian Statistical Modelling. Chichester, UK: Wiley, 2001.
- Gelfand AE, Smith AFM. Sampling-based approaches to calculating marginal densities. J Am Stat Assoc. 1990;85:398-409.[CrossRef][Web of Science]
- Besag J. Spatial interaction and the statistical analysis of lattice systems [with discussion]. J Roy Stat Soc (B). 1974;36:192-236.
- Geweke J. Evaluating the accuracy of sampling based approaches to the calculation of posterior moments. In: Bernardo JM, Berger J, Dawid AP, Smith AFM, eds. Bayesian Statistics 4. Oxford, UK: Oxford University Press, 1992. p. 169-193.
- Spiegelhalter DJ, Best NG, Carlin BP, van der Linde A. Bayesian measures of model complexity and fit. J Roy Stat Soc (B). 2002;64.
- Gelman A, Carlin JG, Stern HS, Rubin DB. Bayesian Data Analysis. London: Chapman & Hall, 1995.
- Felli JC, Hazen GB. Sensitivity Analysis and the Expected Value of Perfect Information. Med Decis Making. 1998;18:95-109.[Abstract/Free Full Text]
- Thompson KM, Graham JD. Going beyond the single number: using probabilistic risk assessment to improve risk management. Human Ecological Risk Assess. 1996;2:1008-1034.
- Thompson KM, Evans JS. The value of improved national exposure information for perchloroethylene (Perc): a case study for dry cleaners. Risk Anal. 1997;17:253-271.[CrossRef][Web of Science]
- Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of heath care technologies. J Health Econ. 2000;18:341-364.[Web of Science]
- Claxton K, Lacey LF, Wlaker SG. Selecting treatments: a decision theoretic approach. J Roy Stat Soc (A). 2000;163:211-226.[CrossRef]
- Fenwick E, Claxton K, Sculpher M, Briggs A. Improving the Efficiency and Relevance of Heath Technology Assessment: The Role of Iterative Decision Analytic Modelling. York, UK: Centre for Health Economics, University of York, 2000.
- Brand KP, Small MJ. Updating uncertainty in an integrated risk assessment: conceptual framework and methods. Risk Anal. 1995;15:719-731.[CrossRef][Web of Science]
- Dakins ME, Toll JE, Small MJ, Brand KP. Risk-based environmental remediation: Bayesian Monte Carlo analysis and the expected value of sample information. Risk Anal. 1996;16:67-79.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Ratcliffe J, Ades AE, Gibb D, Sculpher MJ, Briggs AH. Prevention of mother-to-child transmission of HIV-1 infection: alternative strategies and their cost-effectiveness. Aids. 1998;12:1381-1388.[Web of Science][Medline]
[Order article via Infotrieve]
- Mandelblatt JS, Fryback DG, Weinstein MC, Russell LB, Gold MR, Hadorn DC. Assessing the effectiveness of health interventions. In: Gold MR, Siegel JE, Russell LB, Weinstein MC, eds. Cost-Effectiveness in Health and Medicine. New York: Oxford University Press, 1996. p. 135-175.
- Eddy DM, Hasselblad V. Fast*Pro: Software for Meta-Analysis by the Confidence Profile Method. San Diego, CA: Academic Press, 1992.
- Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR. Bayesian methods in health technology assessment. Health Technol Assess. 2000;4:1-130.[Medline]
[Order article via Infotrieve]
- Giesecke J, Johnson A, Hawkins A, et al. An estimate of the prevalence of human immunodeficiency virus in England and Wales by using a direct method. J Roy Stat Soc (A). 1994;157:89-103.[CrossRef]
- Petruckevitch A, Nicoll A, Johnson AM, Bennet D. Direct estimates of prevalent HIV infection in adults in England and Wales for 1991 and 1993. Genitourin Med. 1997;73:348-354.[Web of Science][Medline]
[Order article via Infotrieve]
- Hughes G, Porter K, Gill N. Indirect methods for estimating prevalent HIV infections: adults in England and Wales at the end of 1993. Epidemiol Infect. 1998;121:165-172.[CrossRef][Medline]
[Order article via Infotrieve]
- Chalmers I, Altman DG. Systematic Reviews. London: BMJ, 1995.
- Song F, Eastwood AJ, Gilbody S, Sutton AJ. Publication and related biases. Health Technol Assess. 2000;4:1-115.[Medline]
[Order article via Infotrieve]
Medical Decision Making, Vol. 22, No. 4,
359-371 (2002)
DOI: 10.1177/0272989X0202200414
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
M. J. Sweeting, D. De Angelis, M. Hickman, and A. E. Ades
Estimating hepatitis C prevalence in England and Wales by synthesizing evidence from multiple data sources. Assessing data conflict and model fit
Biostat.,
October 1, 2008;
9(4):
715 - 734.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
A E Ades, N. J Welton, D. Caldwell, M. Price, A. Goubar, and G. Lu
Multiparameter evidence synthesis in epidemiology and medical decision-making
J Health Serv Res Policy,
October 1, 2008;
13(suppl_3):
12 - 22.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
A. H Briggs
New methods of analysing cost effectiveness
BMJ,
September 29, 2007;
335(7621):
622 - 623.
[Full Text]
[PDF]
|
|
|
|
|
|
|
B. Groot Koerkamp, M.G. M. Hunink, T. Stijnen, J. K. Hammitt, K. M. Kuntz, and M. C. Weinstein
Limitations of Acceptability Curves for Presenting Uncertainty in Cost-Effectiveness Analysis
Med Decis Making,
March 1, 2007;
27(2):
101 - 111.
[Abstract]
[PDF]
|
|
|
|
|
|
|
P. M. McMahon, A. M. Zaslavsky, M. C. Weinstein, K. M. Kuntz, J. C. Weeks, and G. S. Gazelle
Estimation of Mortality Rates for Disease Simulation Models Using Bayesian Evidence Synthesis
Med Decis Making,
September 1, 2006;
26(5):
497 - 511.
[Abstract]
[PDF]
|
|
|
|
|
|
|
G. B. Hazen and M. Huang
Large-Sample Bayesian Posterior Distributions for Probabilistic Sensitivity Analysis
Med Decis Making,
September 1, 2006;
26(5):
512 - 534.
[Abstract]
[PDF]
|
|
|
|
|
|
|
N. J. Welton and A. E. Ades
Estimation of Markov Chain Transition Probabilities and Rates from Fully and Partially Observed Data: Uncertainty Propagation, Evidence Synthesis, and Model Calibration
Med Decis Making,
November 1, 2005;
25(6):
633 - 645.
[Abstract]
[PDF]
|
|
|
|
|
|
|
A. E. Ades, G. Lu, and J. P. T. Higgins
The Interpretation of Random-Effects Meta-Analysis in Decision Models
Med Decis Making,
November 1, 2005;
25(6):
646 - 654.
[Abstract]
[PDF]
|
|
|
|
|
|
|
N. Hawkins, D. Epstein, M. Drummond, J. Wilby, A. Kainth, D. Chadwick, and M. Sculpher
Assessing the Cost-Effectiveness of New Pharmaceuticals in Epilepsy in Adults: The Results of a Probabilistic Decision Model
Med Decis Making,
September 1, 2005;
25(5):
493 - 510.
[Abstract]
[PDF]
|
|
|
|
|
|
|
F. Yokota and K. M. Thompson
Value of Information Literature Analysis: A Review of Applications in Health Risk Management
Med Decis Making,
June 1, 2004;
24(3):
287 - 298.
[Abstract]
[PDF]
|
|
|
|
|
|
|
A. E. Ades, G. Lu, and K. Claxton
Expected Value of Sample Information Calculations in Medical Decision Modeling
Med Decis Making,
March 1, 2004;
24(2):
207 - 227.
[Abstract]
[PDF]
|
|
|
|
|
|
|
A. H. Briggs, A. E. Ades, and M. J. Price
Probabilistic Sensitivity Analysis for Decision Trees with Multiple Branches: Use of the Dirichlet Distribution in a Bayesian Framework
Med Decis Making,
July 1, 2003;
23(4):
341 - 350.
[Abstract]
[PDF]
|
|
|
|
|
