TY - JOUR
T1 - Longitudinal Measurement Invariance of the Behavioral Health Measure in a Clinical Sample
AU - Coleman, Jeremy J.
AU - Dong, Yixiao
AU - Dumas, Denis
AU - Owen, Jesse
AU - Kopta, Mark
N1 - Publisher Copyright:
© 2020 American Psychological Association
PY - 2022
Y1 - 2022
N2 - The practice of routine outcome monitoring (ROM) has grown in popularity and become a fixture in feedback-supported clinical practice and research. However, if the interpretation of an ROM measurechanges over time, treatment outcome scores may be inaccurate and produce erroneous or misguidedinterpretations of client progress and therapist efficacy. The current study examined whether factorialinvariance held when using the Behavioral Health Measure (BHM-20) longitudinally in a clinical sample(n = 12,467). Using multidimensional item response theory– based models for the investigation of theBHM-20 factor structure, at a single time point and then longitudinally. Based on the original factorstructure of the BHM-20 a unidimensional model, a three-factor orthogonal model, and a three-factorcorrelated model were fit to the data, indicating poor model fit with the proposed three-factor orunidimensional models. Next, using exploratory factor analysis and subsequent multidimensional itemresponse theory procedures, a new 4-factor (General Distress, Life Functioning, Anxiety, and Alcohol/Drug Use) model was proposed with improved model-fit statistics. Finally, when testing the longitudinalinvariance of the BHM-17 over 10 sessions of treatment, it was found to be fully consistent. The currentstudy proposes the use of a 17-item, 4-factor model for a new understanding of the BHM-17.
AB - The practice of routine outcome monitoring (ROM) has grown in popularity and become a fixture in feedback-supported clinical practice and research. However, if the interpretation of an ROM measurechanges over time, treatment outcome scores may be inaccurate and produce erroneous or misguidedinterpretations of client progress and therapist efficacy. The current study examined whether factorialinvariance held when using the Behavioral Health Measure (BHM-20) longitudinally in a clinical sample(n = 12,467). Using multidimensional item response theory– based models for the investigation of theBHM-20 factor structure, at a single time point and then longitudinally. Based on the original factorstructure of the BHM-20 a unidimensional model, a three-factor orthogonal model, and a three-factorcorrelated model were fit to the data, indicating poor model fit with the proposed three-factor orunidimensional models. Next, using exploratory factor analysis and subsequent multidimensional itemresponse theory procedures, a new 4-factor (General Distress, Life Functioning, Anxiety, and Alcohol/Drug Use) model was proposed with improved model-fit statistics. Finally, when testing the longitudinalinvariance of the BHM-17 over 10 sessions of treatment, it was found to be fully consistent. The currentstudy proposes the use of a 17-item, 4-factor model for a new understanding of the BHM-17.
KW - Invariance
KW - Outcomes
KW - Psychotherapy
KW - Routine outcome monitoring
UR - http://www.scopus.com/inward/record.url?scp=85087215204&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85087215204&partnerID=8YFLogxK
U2 - 10.1037/cou0000524
DO - 10.1037/cou0000524
M3 - Article
C2 - 32584057
AN - SCOPUS:85087215204
SN - 0022-0167
VL - 69
SP - 100
EP - 110
JO - Journal of Counseling Psychology
JF - Journal of Counseling Psychology
IS - 1
ER -