Generalizability and Representativeness: Considerations for Internet-Based Research on Substance Use Behaviors

Substance use is frequently studied using nonprobability internet-based samples. It is difficult to evaluate the utility of these samples without a clear understanding of two key concepts: generalizability and representativeness. Part 1 of this article (a) offers a particular viewpoint on the distinctions and relations between these two concepts, (b) suggests that purposive (i.e., nonprobability) samples, when used carefully, can be used to construct valid scientific generalizations, and (c) explores some analytical consequences of sampling decisions that change sample heterogeneity. Part 2 of this article explores the overlap between internet-based sampling of substance use behaviors and the concepts discussed in Part 1. Specifically, Part 2 reviews relevant literature and presents example analyses of an internet-based cannabis use data set to highlight (a) strengths and weaknesses of internet-based sampling and (b) how unique elements of a given online platform (e.g., primary motive for visiting the platform) and the substance being studied (e.g., degree of societal stigma) might inform the types of boundaries, caveats, qualifiers, and limitations that are incorporated into a generalization crafted based on the data. Public Health Significance Substance use researchers frequently employ internet-based methods to collect nonrandom samples. Despite their many limitations, internet-based methods and samples can contribute valuable scientific insights to inform substance use public health efforts. To help researchers make these contributions, this article clarifies the concepts of representativeness and generalizability and provides guidepost considerations for researchers related to the collection, analysis, and interpretation of internet-based samples of substance use behaviors.

Automated summary

This article discusses the application and limitations of nonprobability internet-based samples in substance use research, emphasizing the importance of representativeness and generalizability in the study.