Familywise Error Rate

Do p values lose their meaning in exploratory analyses? It depends how you define the familywise error rate

Several researchers have recently argued that p values lose their meaning in exploratory analyses due to an unknown inflation of the alpha level (e.g., Nosek & Lakens, 2014; Wagenmakers, 2016). For this argument to be tenable, the familywise error …

Inconsistent multiple testing corrections: The fallacy of using family-based error rates to make inferences about individual hypotheses

During multiple testing, researchers often adjust their alpha level to control the familywise error rate for a statistical inference about a joint union alternative hypothesis (e.g., “H1,1 or H1,2”). However, in some cases, they do not make this …

Familywise Error Rate

Do p values lose their meaning in exploratory analyses? It depends how you define the familywise error rate

Inconsistent multiple testing corrections: The fallacy of using family-based error rates to make inferences about individual hypotheses

Help us improve the FORRT website