Close
This site uses cookies

By using this site, you consent to our use of cookies. You can view our terms and conditions for more information.

An Introduction to Optimal Experimental Design

Authors
Prof. Jay I. Myung
The Ohio State University ~ Psychology
Mark Pitt
Ohio State University ~ Department of Psychology
Abstract

Progress in science depends on well-designed experiments, yet when it comes to testing computational models, good design can be elusive because model similarities and differences are difficult to assess. Further, observations can be expensive and time-consuming to acquire (e.g., fMRI scans, children, clinical populations). There has been a growing interest by researchers in the design of adaptive experiments that lead to rapid accumulation of information about the phenomenon under study with the fewest possible measurements. In addressing this challenge, statisticians have developed optimal experimental design (OED) methods that combine the power of statistical computing techniques with the predictive precision of the formal models, yielding experiments that are highly efficient and maximally informative with respect to a given experimental objective. This presentation provides an overview of OED with an emphasis on recent developments and applications in the behavioral sciences.

Tags

Keywords

computational cognition
adaptive experimentation
active learning
Bayesian modeling

Topics

Cognitive Modeling
Bayesian Modeling
Discussion
New
does this work with all models? Last updated 4 years ago

Thank you for your clear talk! I was wondering whether there are any constraints on the kinds of computational models that can be used with this method, given the necessity for Bayesian optimization.

Dr. Marieke Van Vugt 1 comment
Reference - ADO: power vs. exponential Last updated 4 years ago

Could you provide a reference where you assess the global utility of the power and exponential functions with ADO using human data? I'd be curious to see which of the two functions is considered the "most optimal" one according to ADO.

Mr. Pierre Gianferrara 1 comment

https://sites.google.com/view/oed-symposium-mathpsych-2020/

Mark Pitt 1 comment
Cite this as:

Myung, J., & Pitt, M. (2020, July). An Introduction to Optimal Experimental Design. Paper presented at Virtual MathPsych/ICCM 2020. Via mathpsych.org/presentation/33.