Common Hour
Method notes · Replication and scale

What large-scale prediction work suggests about single constructs

A 2020 analysis across 43 longitudinal datasets, and what it implies for any one variable in relationship research.

Anyone reading a single-construct finding in relationship science eventually runs into a scale question: how much of the variation in relationship quality does any one variable account for, once many variables are considered together?

A 2020 paper in the Proceedings of the National Academy of Sciences, led by Samantha Joel and Paul Eastwick with a large group of collaborators, addressed this directly. The team assembled 43 longitudinal datasets covering more than 11,000 couples and applied machine learning models to compare how well a wide range of self-reported variables predicted relationship quality.

The shape of the result

Three features of the result are worth carrying forward.

First, variables describing a person’s own view of the specific relationship — satisfaction, commitment, appreciation, perceived partner commitment — predicted relationship quality more strongly than variables describing individual traits or a partner’s self-reported characteristics.

Second, the predictive ceiling was modest overall. Even with many variables and flexible models, a substantial share of the variance remained unaccounted for, and the models did poorly at predicting change over time.

Third, and most relevant to reading any individual paper: no single variable dominated. The predictive contribution was spread across a set of related relationship-specific judgments that correlate with each other.

What follows for a single-construct literature

Capitalization research studies one narrow class of exchange. Work at the scale of the 2020 analysis suggests a general caution that applies to it and to every neighbouring construct: a reliably detected association can still be a small contributor to an outcome that many measured and unmeasured things also bear on.

This is a statement about effect size and predictive value, not about whether the underlying phenomenon exists. Both can hold at once, and conflating them is the most common error in secondhand summaries of this field.

Prediction and explanation are different goals

A study designed to predict an outcome and a study designed to explain a mechanism are answering different questions, and a variable can perform poorly at one while remaining interesting for the other. The 2020 analysis was a prediction exercise: it asked how much of the variation in relationship quality a set of measured variables could account for, not why any particular association exists.

That distinction keeps two conclusions from being confused. Weak prediction across a population does not establish that a described process is absent within it, and a well-documented process does not by itself imply that measuring it will forecast much about a given couple. Papers in this area are generally explicit about which question they are answering; summaries of them frequently are not.

The wider replication context

The analysis arrived during a decade-long re-examination of methods across psychology. The Open Science Collaboration’s 2015 report in Science, which attempted replications of a large set of published psychology studies and found that a substantial proportion did not replicate at the original effect size, changed how the field reports and interprets single studies.

Practices that followed — preregistration, larger samples, published analysis plans, data sharing — are now visible in newer work in this area, and their absence in older work is a reason to read the older papers with that context in mind rather than a reason to discard them.

A reading posture

The useful posture for this literature is neither dismissal nor overstatement. Studies were run, measurements were taken, associations were reported, and the researchers documented what those measurements could and could not support. Common Hour publishes with that documentation attached, because the qualifications are part of the finding rather than a footnote to it.

Sources

  1. Joel, S., Eastwick, P. W., Allison, C. J., et al. (2020). Machine learning uncovers the most robust self-report predictors of relationship quality across 43 longitudinal couples studies. Proceedings of the National Academy of Sciences, 117(32).
  2. Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349(6251).
  3. Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54.

Citations point to the published record. Where a study’s limits are noted above, those limits are stated by the authors in the papers themselves.

← Back to the library