Construct Validation of the Social-Emotional Character Development Scale in Belize: Measurement Invariance Through Exploratory Structural Equation Modeling (open access)

Construct Validation of the Social-Emotional Character Development Scale in Belize: Measurement Invariance Through Exploratory Structural Equation Modeling

Social-emotional learning (SEL) measures assessing social-emotional learning and character development across a broad array of constructs have been developed but lack construct validity. Determining the efficacy of educational interventions requires structurally valid measures which are generalizable across settings, gender, and time. Utilizing recent factor analytic methods, the present study extends validity literature for SEL measures by investigating the structural validity and generalizability of the Social-Emotional and Character Development Scale (SECDS) with a large sample of children from schools in Belize (n = 1877, ages 8 to13). The SECDS exhibited structural and generalizability evidence of construct validity when examined under exploratory structural equation modeling (ESEM). While a higher order confirmatory factor structure with six secondary factors provided acceptable fit, the ESEM six-factor structure provided both substantive and methodological advantages. The ESEM structural model situates the SECDS into the larger body of SEL literature while also exhibiting generalizability evidence over both gender and time.
Date: August 2014
Creator: Hinerman, Krystal M.
System: The UNT Digital Library
Criterion Validity of Common Career Interest Inventories: Relative Efficacy with High School Seniors (open access)

Criterion Validity of Common Career Interest Inventories: Relative Efficacy with High School Seniors

Professional school counselors frequently use career interest inventories as part of a comprehensive guidance program to help students create a post-secondary school plan. The present study evaluates the validity of three commonly used interest inventories, the Myers-Briggs Type Indicator, Self-Directed Search, and Strong Interest Inventory on field of study choice for graduating high school seniors (N = 616) from a large, suburban high school in Texas. Students identified their intended postsecondary field of study category, were randomly assigned using stratification to three groups, and each group completed a different inventory. Group membership was evaluated to establish covariate balance on a wide variety of indicators. Data from each group was evaluated to determine the extent to which the inventory predicted the chosen field of study, as well as Other and Undeclared categories using logistic regression models. None of the inventory models suggest that the inventory accurately predicts Other or Undeclared outcomes. For students selecting intended postsecondary fields of study, the Self Directed Search predicts such outcomes better than other measures. Professional school and career counselors should consider the SDS in addition to narrative counseling strategies to add greater precision with career decision making among clients and students.
Date: August 2014
Creator: Martin, Summer M.G.
System: The UNT Digital Library
A Structural and Psychometric Evaluation of a Situational Judgment Test: The Workplace Skills Survey (open access)

A Structural and Psychometric Evaluation of a Situational Judgment Test: The Workplace Skills Survey

Some basic but desirable employability skills are antecedents of job performance. The Workplace Skills Survey (WSS) is a 48-item situational judgment test (SJT) used to assess non-technical workplace skills for both entry-level and experienced workers. Unfortunately, the psychometric evidence for use of its scores is far from adequate. The purpose of current study was two-fold: (a) to examine the proposed structure of WSS scores using confirmatory factor analysis (CFA), and (b) to explore the WSS item functioning and performance using item response theory (IRT). A sample of 1,018 Jamaican unattached youth completed the WSS instrument as part of a longitudinal study on the efficacy of a youth development program in Jamaica. Three CFA models were tested for the construct validity of WSS scores. Parameter estimations of item difficulty, item discrimination, and examinee’s proficiency estimations were obtained with item response theory (IRT) and plotted in item characteristics curves (ICCs) and item information curves (IICs). Results showed that the WSS performed quite well as a whole and provided precise measurement especially for respondents at latent trait levels of -0.5 and +1.5. However, some modifications of some items were recommended. CFA analyses showed supportive evidence of the one-factor construct model, while the six-factor …
Date: August 2014
Creator: Wei, Min
System: The UNT Digital Library