Background
Analysts tend to seek evidence for the first hypothesis that comes to mind. Heuer catalogued these cognitive limits and proposed ACH as a procedure that forces comparison among hypotheses.
Eight steps
- Identify all possible hypotheses.
- List significant evidence and arguments.
- Build a matrix of hypotheses and evidence and rate consistency.
- Drop evidence with no diagnostic value.
- Draw tentative conclusions by trying to disprove hypotheses.
- Check how much the conclusion rests on a few critical items.
- Report the relative likelihood of all hypotheses.
- Identify milestones that would change the judgment.
Strengths and limits
- Focuses on disconfirming rather than confirming evidence.
- Leaves an audit trail for review and debate.
- Fails if the hypothesis set is incomplete or evidence is deceptive; experiments show only limited bias reduction.
References
- Heuer, R. J., Jr. (1999). Psychology of Intelligence Analysis. Center for the Study of Intelligence, CIA.
- Heuer, R. J., Jr., & Pherson, R. H. (2010). Structured Analytic Techniques for Intelligence Analysis. CQ Press.
- Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175-220.
- Dhami, M. K., Belton, I. K., & Mandel, D. R. (2019). The analysis of competing hypotheses in intelligence analysis. Applied Cognitive Psychology, 33(6), 1080-1090.