Selection Bias and Sensitivity as Moderators of Prekindergarten Age-Cutoff Regression Discontinuity Study Effects: A Meta-Analysis

The age-cutoff regression discontinuity design (RDD) has emerged as one of the most rigorous quasi-experimental approaches to determining program effects of prekindergarten on literacy and numeracy outcomes for children at kindergarten entry. However, few pre-K meta-analyses have focused attention on validity threats. The current random-effects meta-regression tests the moderating effects of prominent threats to validity, selection bias and sensitivity, on impact estimates generated from age-cutoff regression discontinuity studies from large-scale programs. Results from averaging dependent standardized mean difference effects suggested small positive moderating effects of total attrition and robust 3-month bandwidths on reading effects, but not on math. However, these results were not statistically significant. In contrast, results generated from robust variance estimation yielded a small statistically significant association between total attrition and math effects. These mixed results may warrant further research on prekindergarten evaluation methodology, evaluation estimation methods, and the totality of evidence used to inform policy.
Date: July 2023
Creator: Stewart, Genea K.
System: The UNT Digital Library
Teachers' Perceptions of Professional Development: A Mixed Methods Study (open access)

Teachers' Perceptions of Professional Development: A Mixed Methods Study

Research has identified job context, specific attributes of professional development (PD), and perceived teacher input as factors that contribute to teachers' attitudes. This sequential mixed methods study tested those findings together and further investigated teachers' beliefs and attitudes about their own professional learning. The first phase of data collection included a 5-item attitude survey, demographic information, and two short-answer questions. Multiple regression analysis of the sample (N = 328) showed four statistically significant contributors to teacher attitude: (i) socioeconomic status of the school, (ii) teacher years of experience at the campus, (iii) content area taught, and (iv) degree attained by the teacher. During the second phase, six focus groups were conducted which confirmed earlier findings and revealed four themes in teachers' attitudes: (1) a need and desire for collaborative, engaging PD; (2) perceived interference from outside forces that supplant teachers' own PD goals and wishes; (3) a need to establish a context and a cohesive plan for long-term career and campus goals; and (4) a subgroup of teachers who believe that PD has little inherent value. Limitations and implications are included.
Date: May 2020
Creator: Shurtleff, Kay
System: The UNT Digital Library
Identification of highly gifted 5- and 6-year-old children: Measures to predict academic achievement. (open access)

Identification of highly gifted 5- and 6-year-old children: Measures to predict academic achievement.

Studies indicate the educational needs of highly gifted students are best met through accelerated learning. It is difficult to recognize very young children that are suited for an accelerated curriculum because younger students frequently lack school records or portfolios used to identify gifted students. This study examined the accuracy of cognitive ability and achievement tests in predicting academic achievement by the end of second grade, correlating test results and final grade averages collected from sixteen children ages five to six who entered a public school program for high-ability learners in kindergarten. A multiple regression analysis indicated the Wechsler Preschool and Primary Scale of Intelligence produced the highest mean IQ score and a strong correlation with reading achievement. The Wechsler Individual Achievement Test contributed in small part to the prediction of academic achievement. The Naglieri Nonverbal Ability Test and the Kaufman Brief Intelligence Test-Second Edition had negative correlations with final grade averages, indicating they are not predictors of academic achievement for these students.
Date: May 2010
Creator: Runyon, Lisa
System: The UNT Digital Library

Measuring Creativity in Academic Writing

The demand for a creative workforce has never been higher, yet schools struggle to teach and assess creativity among students predictably and efficiently. Compositions are an effective way to incorporate creativity across the curriculum; however, essays are time consuming for teachers to score for objective quality or subjective creativity. In this study, I explored a) if high creativity scores are related to high quality and sophistication in academic writing, and b) if extant text-mining tools effectively identify quality, sophistication, and creativity in academic essays. I collected 230 essays written by Grade 11 students. Four human-raters analyzed these essays for quality, sophistication, and creativity, and I used text-mining tools designed to assess creativity to analyze the same. Using correlations - including the variables semantic distance (measured against the GloVe corpus), entropy (measured with Shannon's Entropy Index), and idea density (measured with CPIDR5.1) - I assessed both human-raters' and text-mining tools' proficiency at identifying quality, sophistication, and creativity in academic essays. Quality, sophistication, and creativity were also regressed on these same text-mining variables to assess which method - human or computer – and which of the text-mining tools - best predicts these dependent variables. Human-raters' creativity scores correlated with human-raters' quality scores …
Date: December 2022
Creator: Nagel, Janessa Helen Bower
System: The UNT Digital Library
Evaluating Program Diversity and the Probability of Gifted Identification Using the Torrance Test of Creative Thinking (open access)

Evaluating Program Diversity and the Probability of Gifted Identification Using the Torrance Test of Creative Thinking

Multiple criteria systems are recommended as best practice to identify culturally, linguistically, economically diverse students for gifted services, in which schools often incorporate measures of creativity. However, the role of creativity in identification systems and its recruitment of diverse student populations is unclear. The Torrance Test of Creative Thinking (TTCT) is the most widely used norm-referenced creativity test in gifted identification. Although commonly used for identifying talent, little is known on the variability in composite scores on the TTCT-Figural and student demographics (i.e., race/ethnicity, sex, socioeconomic status, English language learning status). This study evaluated student demographic subgroup differences that exist after the initial phase of an identification process (i.e., universal screening, referrals) and examined the relationship among student demographics (i.e., race/ethnicity, free/reduced lunch status, English language learning status, sex), cognitive ability, academic achievement, and creativity, as measured by the TTCT-Figural Form A or B, to the probability of being identified for gifted programs. In a midsized school district in the state of Texas, findings indicate several demographic differences for students who were referred or universally screened across the measures of cognitive ability, academic achievement, and creativity. However, there were lower differences when using the TTCT-Figural. Results of a hierarchical generalized …
Date: August 2021
Creator: Lee, Lindsay Eryn
System: The UNT Digital Library
Examining the Perceived Efficacy of Professional Learning in Gifted and Talented Education (open access)

Examining the Perceived Efficacy of Professional Learning in Gifted and Talented Education

This research aims to examine current practices in gifted and talented educator professional learning, as well as teacher attitudes, beliefs, and experiences towards gifted education in order to explore opportunities to further develop and improve professional learning structures. Through a qualitative methodology following the constructivist-interpretivist paradigm, this research utilizes a phenomenological interview design in which data from educator interviews are examined through thematic analysis. To support and further extrapolate on the feedback from the interviews, this research also includes a document analysis of the published descriptions of 30-hour educator training required for those providing GT services in the state of Texas. The thematic analysis of interviews identified three major themes and two minor themes after engaging in a deep analysis of the interview transcriptions. These major themes are the (1) utility of professional learning, (2) shared control of learning, and (3) understanding the whole student. Minor themes are (i) long-term career growth and (ii) role of professional support networks and connections. Results of the document analysis illustrate that the most frequent descriptions are associated with the abilities participants will take from the learning. Within this descriptive code, most of the language focused on learner competence, while few of the descriptions …
Date: July 2023
Creator: Lockhart, Kari Beth
System: The UNT Digital Library