This column provides a brief synopsis and reference information for select recent journal publications. Note that this is only a short sampling of publications and is not intended as a comprehensive listing.
The Unappreciated Heterogeneity of Effect Sizes: Implications for Power, Precision, Planning of Research, and Replication
While the current literature on power and research design has generally assumed that there is a single effect size, this publication discusses the importance of considering heterogeneity of effect size. The goal of this work is to describe in detail the implications of varying effect sizes for the planning and conduct of research.
Kenny, D. A., & Judd, C. M. (2019). The unappreciated heterogeneity of effect sizes: Implications for power, precision, planning of research, and replication. Psychological Methods. Advance online publication. https://dx.doi.org/10.1037/met0000209opens in new window
Bayesian Versus Frequentist Estimation for Structural Equation Models in Small Sample Contexts: A Systematic Review
Presents a systematic literature review aggregating information from numerous simulation studies to explore and summarize the performance of Bayesian and frequentist estimation for structural equation models with small sample sizes. With small samples, the use of Bayesian estimation with diffuse default priors can result in severely biased estimates — the levels of bias are often even higher with frequentist methods. This bias can only be decreased by incorporating prior information. Recommendations are provided on how to construct thoughtful priors.
Smid, S. C., McNeish, D., Miočević, M., & van de Schoot, R. (2019). Bayesian Versus Frequentist Estimation for Structural Equation Models in Small Sample Contexts: A Systematic Review. Structural Equation Modeling: A Multidisciplinary Journal, 1-31.
Prediction From Latent Classes: A Demonstration of Different Approaches to Include Distal Outcomes in Mixture Models
Including auxiliary variables such as antecedent and consequent variables in mixture models provides valuable insight in understanding the population heterogeneity embodied by a latent class variable. This paper focuses on one type of auxiliary variable — distal outcomes —providing an overview of the methods currently available for estimating the effects of latent class membership on subsequent distal outcomes. The recommended methods are illustrated in the software packages Mplus and Latent Gold in the context of a meaningful application.
Nylund-Gibson, K., Grimm, R. P., & Masyn, K. E. (2019). Prediction from latent classes: A demonstration of different approaches to include distal outcomes in mixture models. Structural Equation Modeling: A Multidisciplinary Journal, 1-19.
Sample Size Planning for Detecting Mediation Effects: A Power Analysis Procedure Considering Uncertainty in Effect Size Estimates
Uncertainty in effect size estimates has been considered in other sample size planning contexts (e.g., t-test, ANOVA), but has not been handled properly for planning mediation studies. The authors of this article propose an easy-to-use sample size planning method for testing mediation with uncertainty in effect size estimates considered. Simulation studies were conducted to demonstrate the impact of uncertainty in effect size estimates on power of testing mediation, and to provide sample size suggestions under different levels of uncertainty. Empirical examples of the method are provided, and R functions and a web application were developed to facilitate implementation.
Liu, X., & Wang, L. (2019). Sample Size Planning for Detecting Mediation Effects: A Power Analysis Procedure Considering Uncertainty in Effect Size Estimates. Multivariate behavioral research, 1-18.
Managing Validity Versus Reliability Trade-Offs in Scale-Building Decisions
When psychologists build surveys, they try to maximize validity and reliability. Yet sometimes these goals are in tension such that improving one means sacrificing the other — a trade-off. This article discusses why and when such trade-offs occur so that scale builders can better manage them, and consumers of scale-based research can increase demand for better scales.
Clifton, J. D. W. (2019, August 15). Managing Validity Versus Reliability Trade-Offs in Scale-Building Decisions. Psychological Methods. Advance online publication. https://dx.doi.org/10.1037/met0000236opens in new window
Guidelines for the Publication Corner column:
Have you seen a recent publication that you think would be of great interest to Div. 5 membership? Please feel free to share suggestions for publications to include in this column. Please send your ideas to The Score editor, Gill Sitarenios. Please be sure to include full reference details and a short synopsis (two-three sentences) of the publication. Use “Publication Corner” in the subject line of the email.
