The ESM-Q


Next to collecting ESM items, the repository aims to develop a framework for evaluating ESM items, to help improve current measurement practices in ESM studies. To reach this goal, we developed the ESM-Q, a consensus-based quality assessment tool for ESM items. It can be used to evaluate existing ESM items or during the development of new items for new studies.


The ESM-Q consists of:

  • 10 core quality criteria that are always applicable when item and target construct are known.
  • 15 supplemental criteria that are only applicable for certain types of items or when additional information is available (e.g., on the target population or the other items in the questionnaire).


The ESM-Q criteria were developed in a 4-phase Delphi study with over 40 international ESM experts.



Want to learn more or use the ESM-Q in your research?


Check out the ESM-Q scoring template here: https://osf.io/jqg78


And find more information about its development and how to apply the ESM-Q here: https://osf.io/preprints/psyarxiv/sjynv_v3 (preprint)
https://doi.org/10.3758/s13428-025-02626-1(published version)



Citation


Eisele, G., Hiekkaranta, A., Kunkels, Y. K., van Ballegooijen, W., Bartels, S. L., Bastiaansen, J. A., ... & Kirtley, O. J. (2025). ESM-Q: A consensus-based quality assessment tool for experience sampling method items. Behavior Research Methods, 57(4), 1-20.