A statistical test for the optimality of deliberative time allocation
Whenever we make a choice, we must also decide how much time to spend making it. Many theories of decision-making crucially assume that this deliberation perfectly balances the costs of time expenditure and the benefits of better decisions. However, might we “overthink” or “underthink” decisions? Here, I propose and implement a method to precisely determine whether people are optimally spending their time on deliberation, accounting for individual preferences. This test evaluates the consistency of underlying preferences for time when incentives change, which is a necessary condition for optimality. This enables a more comprehensive analysis of rationality in a variety of contexts. I demonstrate how the test can reveal departures from optimality using two motion discrimination experiments in which I vary task difficulty and monetary incentives.
KeywordsDecision making Response time Optimality Speed-accuracy tradeoff Sequential sampling models
Thanks to Colin Camerer, Jaron Colas, Hayley Dorfman, Sam Gershman, Taisuke Imai, Ian Krajbich, and Tomasz Strzalecki for helpful comments and discussions. Funding from the Social Sciences and Humanities Research Council of Canada and the Harvard Mind Brain Behavior Interfaculty Initiative is gratefully acknowledged.
- Bhui, R. (2018). Falling behind: Time and expectations based reference dependence. Decision. Advance online publication, https://doi.org/10.1037/dec0000102.
- Binmore, K. (2009) Rational decisions. Princeton: Princeton University Press.Google Scholar
- Clithero, J.A. (2016). Response times in economics: Looking through the lens of sequential sampling models. SSRN Working Paper 2795871.Google Scholar
- Donders, F.C. (1869/1969). On the speed of mental processes. Acta Psychologica, 30, 412–431.Google Scholar
- Gintis, H. (2009). The bounds of reason: Game theory and the unification of the behavioral sciences.Google Scholar
- Jensen, A.R. (2006) Clocking the mind: Mental chronometry and individual differences. New York: Elsevier.Google Scholar
- Laming, D.R.J. (1968) Information theory of choice-reaction times. New York: Academic Press.Google Scholar
- Milosavljevic, M., Malmaud, J., Huth, A., Koch, C., & Rangel, A. (2010). The drift diffusion model can account for the accuracy and reaction time of value-based choices under high and low time pressure. Judgment and Decision Making, 5(6), 437–449.Google Scholar
- Robertson, T., Wright, F.T., & Dykstra, R. (1988) Order restricted statistical inference. New York: Wiley.Google Scholar
- Wald, A. (1947) Sequential analysis. New York: Wiley.Google Scholar