GESIS Training Courses

Scientific Coordination

Julia Leesch
Tel: +49 221 47694-169

Administrative Coordination

Claudia ODonovan-Bellante

Hypothesis Evaluation: p-values, Bayes factor, and information criteria

Prof. Herbert Hoijtink, Prof. Rebecca Kuiper

Location: Mannheim B2,8 / Course language: Englisch

About the lecturer - Prof. Herbert Hoijtink

About the lecturer - Prof. Rebecca Kuiper

Course description

The evaluation of hypotheses is a core feature of research in the behavioural, social, and biomedical sciences. In the last decade, there has been a lot of attention for inappropriate use of hypotheses testing by journals (publication bias) and authors (questionable research practices) as the main causes of the replication crisis. This 3-day workshop will use different perspectives (classical, Bayesian, information theoretic) to teach participants in a non-technical manner the theory underlying hypothesis evaluation and the appropriate application of hypothesis evaluation.
On Day 1, we will discuss null-hypothesis significance testing, questionable research practices, publication bias, and the replication crisis will be discussed. This day will also be used to give a hands-on introduction to statistical analyses using R. 
During Day 2, hypothesis evaluation using the Bayes factor will be discussed. There will among others be attention for Bayesian error probabilities, Bayesian updating, the use of Bayesian hypothesis evaluation for the evaluation of replication studies, and combining evidence from multiple studies addressing the same research question.
Day 3 will start with an introduction of information criteria (i.e., AIC and its generalization, the GORIC) and a brief repetition of theory-based hypotheses. Subsequently, it will be elaborated how the GORIC can be used to evaluate null, alternative, and theory-based hypotheses. There will be attention for GORIC weights, which have a nice interpretation. This day will, like Day 2, be concluded (with a hands-on part) with examples of replication research and combining evidence from multiple studies in which informative hypotheses play an important role.


Target group

The workshop is targeted at students and researchers who want to learn how to evaluate theory-based hypotheses.
The course will be non-technical in nature, that is, it is targeted at students and researchers who want to use the approaches presented for the evaluation of their own data. These can come from a variety of fields, like, for example, sociology, psychology, education, human development, marketing, business, biology, medicine, political science, and communication sciences.

Please bring your own laptop to this course (for the hands-on parts).

Learning objectives

After participating in the workshop, participants can evaluate theory-based hypotheses on their own data set. And, in case of replication studies, they can also update their hypotheses and/or combine evidence for these hypotheses from these studies.


Participants should at least have finished two years of bachelor education. We expect participants to be familiar with ANOVA, multiple regression, and the p-value. 


Recommended readings

More Information