Call: “Do Experiments Replicate?”

From September 22 to 23, 2026, the workshop “Do Experiments Replicate? Philosophical Reflections on the Use and Misuse of Statistics and Econometrics” will take place at the Jagiellonian University, Poland.

Abstract submissions are possible until June 1, 2026. The call reads:

The workshop “Do experiments replicate? Philosophical Reflections on the Use and Misuse of Statistics and Econometrics” aims to provide a forum for exchanging ideas on the replicability of randomized experiments, such as randomized field experiments in economics, randomized controlled trials and preclinical studies in medicine, and psychological experiments.

The workshop promotes philosophical and methodological discussions of conceptual and methodological issues in statistical analysis, econometric modeling, and the methodology of experimentation.

Keynote Speakers:

• Barbara Osimani
• Samuel Fletcher

Experimental results are considered reliable because, under comparable conditions, they are expected to yield similar outcomes. However, this assumption has recently been challenged by numerous replication efforts that report results differing from those of the original studies in psychology, medicine, biology, the social sciences, and economics. A surprisingly large fraction of published findings have been found to be non-replicable. Replicability rates range from 11% for in vitro and in vivo preclinical research to 60–90% for clinical trials. Experimental economists fall within this range and, like psychological experimenters, achieve around 60% replicability.

The replication crisis has called into question the credibility of published findings and undermined trust in science. However, the replication crisis, with few exceptions, has received only limited attention from philosophy of science. Despite the efforts of several pioneers, the philosophical and conceptual problems in randomized controlled trials, randomized field experiments, laboratory experiments, econometric modeling, and the statistical analysis of experimental data remain largely uncharted territory in the philosophy of science. The workshop aims to establish a forum for exchanging ideas among philosophers of medicine and economics, philosophers of statistics, and methodologically inclined researchers interested in the conceptual problems of the replication crisis.

The Workshop “Do experiments replicate? Philosophical Reflections on the Use and Misuse of Statistics and Econometrics” invites contributions that focus on experimentation and statistical analysis in economics and medicine, as well as problems that trouble statistical inference from experiments, broadly construed.

Some exemplary topics of talks:

• The design of randomized experiments in medicine and economics.
• Statistical hypothesis testing.
• Non-frequentist approaches to comparing treatment and control group outcomes.
• Comparisons of design-based and model-based inference.
• Estimating statistical models.
• Measuring replication success and replicability rates.
• Assessing the quality of empirical evidence.
• Making inferences from the literature review with conflicting results.
• Other problems in philosophy of statistics related to the replication crisis.

Abstracts no longer than 500 words (including references) should be submitted in an attachment, not including author details, by email with the subject ‘replication workshop’ sent to: mariusz.maziarz@uj.edu.pl.

Deadline for submission: June 1st, 2026

Decisions will be announced by June 15th, 2026.

This activity was supported by a grant funded by the Strategic Program Excellence Initiative at the Jagiellonian University.

#Economics #Medicine #Psychology #Replication #Statistics