Near-Balanced Incomplete Block Designs, With an Application to Poster Competitions

Xiaoyue Niu, James L. Rosenberger

Research output: Contribution to journalArticle

Abstract

Judging scholarly posters creates a challenge to assign the judges efficiently. If there are many posters and few reviews per judge, the commonly used balanced incomplete block design is not a feasible option. An additional challenge is an unknown number of judges before the event. We propose two connected near-balanced incomplete block designs that both satisfy the requirements of our setting: one that generates a connected assignment and balances the treatments and another one that further balances pairs of treatments. We describe both fixed and random effects models to estimate the population marginal means of the poster scores and rationalize the use of the random effects model. We evaluate the estimation accuracy and efficiency, especially the winning chance of the truly best posters, of the two designs in comparison with a random assignment via simulation studies. The two proposed designs both demonstrate accuracy and efficiency gain over the random assignment.

Original languageEnglish (US)
Pages (from-to)159-164
Number of pages6
JournalAmerican Statistician
Volume73
Issue number2
DOIs
StatePublished - Apr 3 2019

Fingerprint

Balanced Incomplete Block Design
Assignment
Random Effects Model
Fixed Effects Model
Assign
Simulation Study
Unknown
Evaluate
Requirements
Estimate
Demonstrate
Design
Random assignment
Random effects model

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Mathematics(all)
  • Statistics, Probability and Uncertainty

Cite this

@article{252b823ea90441babd7aae01d33cef06,
title = "Near-Balanced Incomplete Block Designs, With an Application to Poster Competitions",
abstract = "Judging scholarly posters creates a challenge to assign the judges efficiently. If there are many posters and few reviews per judge, the commonly used balanced incomplete block design is not a feasible option. An additional challenge is an unknown number of judges before the event. We propose two connected near-balanced incomplete block designs that both satisfy the requirements of our setting: one that generates a connected assignment and balances the treatments and another one that further balances pairs of treatments. We describe both fixed and random effects models to estimate the population marginal means of the poster scores and rationalize the use of the random effects model. We evaluate the estimation accuracy and efficiency, especially the winning chance of the truly best posters, of the two designs in comparison with a random assignment via simulation studies. The two proposed designs both demonstrate accuracy and efficiency gain over the random assignment.",
author = "Xiaoyue Niu and Rosenberger, {James L.}",
year = "2019",
month = "4",
day = "3",
doi = "10.1080/00031305.2017.1385534",
language = "English (US)",
volume = "73",
pages = "159--164",
journal = "American Statistician",
issn = "0003-1305",
publisher = "American Statistical Association",
number = "2",

}

Near-Balanced Incomplete Block Designs, With an Application to Poster Competitions. / Niu, Xiaoyue; Rosenberger, James L.

In: American Statistician, Vol. 73, No. 2, 03.04.2019, p. 159-164.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Near-Balanced Incomplete Block Designs, With an Application to Poster Competitions

AU - Niu, Xiaoyue

AU - Rosenberger, James L.

PY - 2019/4/3

Y1 - 2019/4/3

N2 - Judging scholarly posters creates a challenge to assign the judges efficiently. If there are many posters and few reviews per judge, the commonly used balanced incomplete block design is not a feasible option. An additional challenge is an unknown number of judges before the event. We propose two connected near-balanced incomplete block designs that both satisfy the requirements of our setting: one that generates a connected assignment and balances the treatments and another one that further balances pairs of treatments. We describe both fixed and random effects models to estimate the population marginal means of the poster scores and rationalize the use of the random effects model. We evaluate the estimation accuracy and efficiency, especially the winning chance of the truly best posters, of the two designs in comparison with a random assignment via simulation studies. The two proposed designs both demonstrate accuracy and efficiency gain over the random assignment.

AB - Judging scholarly posters creates a challenge to assign the judges efficiently. If there are many posters and few reviews per judge, the commonly used balanced incomplete block design is not a feasible option. An additional challenge is an unknown number of judges before the event. We propose two connected near-balanced incomplete block designs that both satisfy the requirements of our setting: one that generates a connected assignment and balances the treatments and another one that further balances pairs of treatments. We describe both fixed and random effects models to estimate the population marginal means of the poster scores and rationalize the use of the random effects model. We evaluate the estimation accuracy and efficiency, especially the winning chance of the truly best posters, of the two designs in comparison with a random assignment via simulation studies. The two proposed designs both demonstrate accuracy and efficiency gain over the random assignment.

UR - http://www.scopus.com/inward/record.url?scp=85047991696&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85047991696&partnerID=8YFLogxK

U2 - 10.1080/00031305.2017.1385534

DO - 10.1080/00031305.2017.1385534

M3 - Article

AN - SCOPUS:85047991696

VL - 73

SP - 159

EP - 164

JO - American Statistician

JF - American Statistician

SN - 0003-1305

IS - 2

ER -