A Comparative Analysis of Three Forms of Evaluating Management Training Programs (open access)

A Comparative Analysis of Three Forms of Evaluating Management Training Programs

The practice of training evaluation has not kept pace with prescription, and evaluations being being done are frequently negligent of appropriate controls needed to draw valid conclusions. A comparison was made of training outcomes contrasting results obtained using carefully controlled scientific approaches with those from a more popular less scientific approach. The research design involved the collection and analysis of data from a single organizations managerial training program. , Three different methods of training evaluation were studied: an "immediate reaction" rating sheet, a self-report participant survey, and a similar survey completed by t he participants' subordinates. Bo th surv ey r e sul t s showed no signif icant c hang es in on-the-job behavior six weeks after training. In contrast the "immediate reaction" ratings were positive, implying the training program was a "success." Conclusions w ere drawn concerning the validity of methods compared.
Date: December 1985
Creator: Hale, John P.
System: The UNT Digital Library
Holland's Self-Directed Search: A Measure of Interests of Abilities? (open access)

Holland's Self-Directed Search: A Measure of Interests of Abilities?

This study examined the relationship between the sub-components of Holland's Self-Directed Search and independent, objective measures of ability using a comprehensive battery of well-validated tests of primary abilities corresponding to each of Holland's six vocational interest types. The sample consisted of 149 female undergraduate students, ages 18-25. Correlation of the ability measure test scores with the four Self-Directed Search subcomponents revealed that the subtests were not related to corresponding measures of ability in a consistent fashion. Implications for the use of the Self-Directed Search in assessing abilities are discussed along with suggestions for future research investigating the relationhip between interest in ventories and the measurement of primary abilities.
Date: December 1985
Creator: Williams, Richard Earl
System: The UNT Digital Library
Revision of the Logical Reasoning Subtest of the California Test of Mental Maturity (open access)

Revision of the Logical Reasoning Subtest of the California Test of Mental Maturity

The purpose of the study was to develop a revision of the logical reasoning section of the California Test of Mental Maturity which increases its discriminative ability while maintaining an acceptable measure of reliability. Subjects were 102 students of general psychology classes at North Texas State University. All were administered the Logical Reasoning section of the California Test of Mental Maturity in its original form and an experimental revision of it (LRTR). The Wesman Personnel Classification Test was administered at the same time to demonstrate the tests' construct validity. Pearson product-moment correlations, item and homogeneity analyses were run. Results indicated that the revised test correlated significantly with the original test and the WPCT. Internal validity of the revised test was satisfactory, showing an improvement over the original test in terms of clarity, reliability and homogeneity.
Date: December 1986
Creator: Ryan, Patrice M. (Patrice Marie)
System: The UNT Digital Library
The Effect of Type A and Type B Personality and Leadership Style on Absenteeism (open access)

The Effect of Type A and Type B Personality and Leadership Style on Absenteeism

This study explored the relationship of Type A/B personality and leadership style to absenteeism. Absenteeism data were gathered for 243 male fire fighters and fire engineers. Each subject was administered the Jenkins Activity Scale to measure his Type A characteristics and the Leader Behavior Description Questionnaire to measure his perception of his supervisor's leadership style. The results, though non-significant, revealed that: a) Type A's had less absenteeism than type B's; b) Subjects who perceived their supervisors as being low on consideration had less absenteeism than those who perceived their supervisors as being high on this dimension; c) Type A's absenteeism was low and Type B's was high when working under a leader perceived as low on structure. Finally, a weak but significant three-way interaction effect revealed that the highest amount of absenteeism occurred when Type B' s worked under supervisors who were high in consideration and low in structure. The least amount of absenteeism occurred when Type A's worked under supervisors who were high in structure and low in consideration.
Date: August 1987
Creator: Nichols, Judith Ann, 1957-
System: The UNT Digital Library
The Effects of Realistic Job Previews on Turnover in a Financial Services Organization (open access)

The Effects of Realistic Job Previews on Turnover in a Financial Services Organization

Realistic Job Previews have been shown to impact newcomers to jobs through ircreased self-selection, reduced turnover, eased adjustment, improved performance and increased job satisfaction. To address a turnover problem, Realistic Job Previews were implemented in hiring for two entry level positions in half of 539 branch offices of a large financial services organization. Subjects consisted of 122 Service Representatives and 98 Financial Representatives. Eight months after implementation, turnover rates were compared for control and experimental groups. There was no significant difference between turnover among Service Representatives. Financial Representatives in the experimental group had lower turnover rates (p < .10), with the difference increasing over time. Comparing the turnover rates between three and six months tenure resulted in a statistically significant difference (p < .05).
Date: August 1987
Creator: Goerz, Marilyn J.
System: The UNT Digital Library
Validity of the California Psychological Inventory as a Tool for Sales Selection (open access)

Validity of the California Psychological Inventory as a Tool for Sales Selection

The study investigated the predictive validity of the California Psychological Inventory (CPI) as a tool for sales selection. Two analyses were conducted. Study 1 consisted of 20 male home improvement representatives. The average net and gross closing ratios for a six month period were used as the criteria. The results indicted that none of the CPI scales differentiated between poor and good performers when correlated with the secondary criterion of gross closing ratios. These findings were contrary to a previous concurrent validity study. Study 2 investigated month to month retention/separation for 61 home improvement representatives, to determine if the CPI differentiated between short and long term success. Phi coefficients showed no statistical significance between retention/separation and the CPI profile score over time.
Date: August 1987
Creator: Frautschi, Patricia Hinojosa
System: The UNT Digital Library
Predictive Validity of the Retail Employment Inventory for the Selection of Over-the-Road Truck Drivers (open access)

Predictive Validity of the Retail Employment Inventory for the Selection of Over-the-Road Truck Drivers

An independent pilot study suggested that the Retail Employment Inventory (REI) might be predictive of subjectively and objectively measured Over the Road (OTR) truck driver performance. The present validation study consisted of three parts. First, an examination of the relationship between REI scores and 11 objective, performance criteria revealed weak and non-significant correlations. Second, a comparison of subjective ratings and REI scores failed to replicate the findings of the pilot study. And third, to confirm that the task components of the OTR job were correctly identified in the pilot study, a second job analysis was performed. Possible reasons for the failure of the REI to predict OTR performance and directions for future research are discussed.
Date: May 1988
Creator: Nygren, Richard Edwin, 1964-
System: The UNT Digital Library
Development of Biographical Predictors of Cashier Turnover at a Convenience Store Chain (open access)

Development of Biographical Predictors of Cashier Turnover at a Convenience Store Chain

Subjects, 432 convenience store cashiers, were divided into long-tenure and short-tenure groups. Chi-square analysis of application blank information for a weighting sample drawn from both groups revealed two items which significantly (p < .05) differentiated between the long tenure and short-tenure groups: number of previous jobs and full-time/part-time preference. Response weights were computed for these two items and used to calculate composite scores for the remaining holdout sample. A significant reduction in turnover would have occurred at the highest composite score level, if used as a hiring cut off. Results were tempered by several considerations, including a high percentage of false negatives and an insignificant linear relationship between composite scores and tenure.
Date: May 1989
Creator: Huffcutt, Allen Ivan
System: The UNT Digital Library
Evaluation of an Ergonomic Intervention Program for the Prevention of Cumulative Trauma Disorders in Industry (open access)

Evaluation of an Ergonomic Intervention Program for the Prevention of Cumulative Trauma Disorders in Industry

The present study analyzed the health benefits data of employees in a southwestern United States manufacturing plant. The data consisted of the prevalence rates of headaches, muscle injuries, upper respiratory complaints, and colds/flu for baseline (1985) and intervention levels (1986-1988) for five high-risk jobs. The prevalence rates of headaches and muscle injuries decreased significantly (p < .001) from baseline levels for all five job groups. Comparisons with a nontreatment group revealed significant decreases (p < .05) for three of the five job groups. The findings support the efficacy of the ergonomic interventions. A health surveillance system is recommended for early detection and prevention of cumulative trauma disorders.
Date: August 1989
Creator: Villaneuva, Raul
System: The UNT Digital Library
The Relationship of Selected Personality Factors to Turnover Among Restaurant Managers (open access)

The Relationship of Selected Personality Factors to Turnover Among Restaurant Managers

This study investigated the relationship between turnover and personality measures through the application of discriminant analysis in a split sample cross validation design. Four personality tests measuring 34 dimensions of personality were administered to 300 Caucasian male job applicants. The tests were the Fundamental Interpersonal Relations Orientation-Behavior, the Vocational Preference Inventory, a shortened version of the DF-Opinion Survey, and the Guilford Zimmerman Temperament Survey. Ten of the dimensions were initially found to be significantly related to turnover. The shrinkage of the coefficient after cross validation was enough for the loss of statistical significance. It is suggested that personality measures are moderately associated with turnover and that investigations examining methods to reduce turnover should focus on other variables.
Date: August 1989
Creator: Daughtry, Perry
System: The UNT Digital Library
A Concurrent Validation Study of a Paper and Pencil Test Battery for a Sales Position (open access)

A Concurrent Validation Study of a Paper and Pencil Test Battery for a Sales Position

Participating in this study were 251 decorator consultants. The decorator consultant position is a direct sales position. The primary objective of this study was to demonstrate that a relationship existed between decorators' selection test scores and their job performance. The SRA Verbal Form, the EAS Numerical Ability Test, the EAS Space Visualization Test, and the Sales Attitude Checklist were evaluated as potential selection tests. Behavioral criteria and managerial ratings were used to assess job performance. Correlational analyses revealed that all the tests but the SRA Verbal Form were significantly correlated with two or more criteria.
Date: May 1990
Creator: Irons, Deedra Kim
System: The UNT Digital Library
Validation of a Test Battery for the Selection of Driver Managers in a Trucking Organization (open access)

Validation of a Test Battery for the Selection of Driver Managers in a Trucking Organization

This study was a concurrent validation of a paper and pencil test battery used at a national trucking company. Forty-eight driver managers were rated by their immediate supervisors with the performance appraisal covering 12 dimensions of job behavior that was developed by the experimenter. The driver managers were also administered the Wesman Personnel Classification Test, the Watson-Glaser Critical Thinking Appraisal, and the California Psychological Inventory (CPI). A biographical information blank was also developed and validated. Most validity correlations were nonsignificant, with the exception of the Dominance scale r = .25 (p < .05), the Self-control scale r = -.25 (p < .05), the Communanlity scale r = .29 (p < .05), and the Flexibility scale r = -.39 (p < .05), with overall performance.
Date: May 1990
Creator: Cassel, Shirley T. (Shirley Tamsen)
System: The UNT Digital Library
An Empirical Investigation of Criterion Development and the Multiple Criteria Versus Composite Criterion Debate (open access)

An Empirical Investigation of Criterion Development and the Multiple Criteria Versus Composite Criterion Debate

The purpose of this study was to empirically examine two empirically examine two main areas of concern in selecting criteria for validation studies: the development of the criterion and the multiple criteria versus composite criterion debate. Evidence was found for the ability of the various weighting schemes used to generate composites that were statistically and conceptually different from one another. Knowledge of the nature of each composite, along with the multiple criteria approach, proved essential to understanding the composite criterion to the validation process. Selection and treatment of the criterion apparently consist of judgment and individual estimations.
Date: August 1990
Creator: Dailey, Patrick A. (Patrick August)
System: The UNT Digital Library
An Employee Participation Change Project and Its Impact on the Organization: a Case Study (open access)

An Employee Participation Change Project and Its Impact on the Organization: a Case Study

The purpose of this study was to document and assess the consequences of implementing employee involvement in a manufacturing setting. Using a quasi-experimental design, the study utilized information from various sources of data including archives, interview, and questionnaire data for a three to four year period. Time series comparisons were used. The results indicated that production increased initially, but then dropped back to original level. Quality of products increased and continued to improve gradually. The highest rate of improvement was observed in safety. An attempt was made to measure current level of commitment at the plant but was unsuccessful due to a low return rate of questionnaires. Overall, data collected partially support the hypotheses. Implications for further research and practice are discussed.
Date: August 1990
Creator: Roustaei, Simin
System: The UNT Digital Library
Factors Relating to Upper Level Employee Support for Organizational Redesign (open access)

Factors Relating to Upper Level Employee Support for Organizational Redesign

Successful implementation of organizational redesign depends on the support of employees at all levels of the organization. This study looked at some of the factors that are related to employee support for organizational redesign. Subjects (82 support staff members of a small manufacturing plant undergoing organizational change) were administered a survey which measured employee perceptions about the change management process and the disruption the change caused to their daily routine. Eleven variables were assessed as independent variables in terms of their relationship to the dependent variable which was employee support of the organizational change. All eleven variables were significantly related to the dependent variable. The implications of these results and issues for further research was discussed.
Date: August 1990
Creator: Street, Amy
System: The UNT Digital Library
Prediction of the Job Performance of Restaurant Workers Using a Service Orientation Measure (open access)

Prediction of the Job Performance of Restaurant Workers Using a Service Orientation Measure

Service orientation has been suggested to be a work-related behavioral trait that contributes toward overall job performance in certain occupations. Therefore, the Batrus Hollweg Service Questionnaire (SQ), a personality inventory, was hypothesized to predict performance in a sample (N=55) of fast-food restaurant workers whose jobs were primarily composed of service-related elements. A performance evaluation form was created for use as the criterion measure. An alternative scoring system for the SQ was developed, and showed it to be significantly correlated with the criterion. The potential for use of the alternative scoring procedure is discussed.
Date: August 1990
Creator: Blansett, Karen D. (Karen Day)
System: The UNT Digital Library
Relationship of a Situational Interview to the Job Performance of Convenience Store Clerks (open access)

Relationship of a Situational Interview to the Job Performance of Convenience Store Clerks

A situational interview was developed for use in the selection of convenience store cashiers. One hundred two newly hired cashiers were interviewed using the situational interview. Ninety days later, a performance appraisal was completed for all subjects who were still employed. There was no significant difference in interview scores between those still working 90 days after hire and those who were not (t = 1.14, df = 100, n.s.). Correlations between the total interview scores and the total performance appraisal scores were generally very low or negative. Potential explanations for the failure of the interview to predict turnover or job performance are discussed
Date: August 1990
Creator: Hays, Elizabeth J. (Elizabeth Jane)
System: The UNT Digital Library
Development of a Model of Leadership for Self-Managed Teams in a Greenfield Environment (open access)

Development of a Model of Leadership for Self-Managed Teams in a Greenfield Environment

This study identified and defined leader behaviors with two levels of leadership in a self-managed team organization. Job analysis methodology was used. A comparison of task importance values was made within groups and between hierarchical levels in the organization. Identified leader behaviors were compared with effective, traditional leader performance. Qualitative data collected throughout the investigation clarified an integrative model for effective organizations developed from the literature. The model included leader characteristics and team member behaviors when using self-managed teams.
Date: May 1992
Creator: Burress, Mary Ann
System: The UNT Digital Library
Validation of a Selection Battery for Retail Sales People in Telecommunications (open access)

Validation of a Selection Battery for Retail Sales People in Telecommunications

The study employed 206 entry-level, retail sales associates working for a large telecommunications company across 70 store sites. The purpose of the study was to discriminate successful performers from those with little sales potential via a valid, fair, and practical selection procedure. The experimental test set consisted of the General Ability Battery, Sales Attitude Checklist, Wonderlic Personnel Test, SRA Verbal Form, School and College Ability Test Verbal, SPA Arithmetic Index, and SRA Reading Index. Supervisory ratings and percent revenue data were used as measures of sales performance. Based on the multiple regression results, the SPA Reading Index and SRA Verbal Form were chosen to compose the final selection system for the retail sales position.
Date: May 1992
Creator: McTague, T. Scott
System: The UNT Digital Library
Employee Theft: The Relationship of Shrinkage Rates to Job Satisfaction, Store Security, and Employee Reliability (open access)

Employee Theft: The Relationship of Shrinkage Rates to Job Satisfaction, Store Security, and Employee Reliability

The correlation between employee theft and various employee attitudes is investigated with 489 subjects from a large discount store chain located in the southeastern United States. Subjects completed two tests: Personnel Decisions, Inc. 's Employment Inventory/Customer Service Inventory which measures employee reliability and orientation toward providing customer service; and the Organization Responsiveness Questionnaire which measures satisfaction and perceived store security. Individual scores on the tests were correlated with a performance rating form completed by the subject's supervisor. Scores were computed for each store and correlated with inventory shrinkage rates. Results revealed relatively weak correlations for some variables. The multiple regression analysis was unable to significantly predict any of the criterion variables.
Date: August 1992
Creator: LaFosse, W. Greg
System: The UNT Digital Library
Impact of Job Classification Level on Perceived Empowerment Level in a Work Setting (open access)

Impact of Job Classification Level on Perceived Empowerment Level in a Work Setting

Empowerment, which has been described as both a means of effecting higher and more efficient quality work outputs and a means of facilitating greater freedom in the workplace combines elements of philosophy, psychology, and management theory. The perceptions of the present empowerment level of 3500 employees of a division of a major corporation were analyzed using data from an empowerment survey. The results were examined using correlational and factorial measures to test the structure of the survey. ANOVA and pair-wise comparisons were used to examine group differences on five subscales of the survey based on employee level in the organization. Significant differences were found in almost all categories. Rank order for the three levels differed from previous findings, perhaps due to empowerment thrusts.
Date: August 1992
Creator: Thornton, Renita
System: The UNT Digital Library
Relationship Between Employee Age and Perceptions of Work in Self-Managed Work Groups (open access)

Relationship Between Employee Age and Perceptions of Work in Self-Managed Work Groups

Derived from sociotechnical systems theory, autonomous or self-managed work groups are a form of work design in which employees are multi-skilled, take responsibility for the group's tasks, and have discretion over the decisions which impact group performance. Previously collected survey data from 602 employees of a southwestern manufacturing firm were examined via factor analyses and multivariate analysis of variance. Significant differences were found for self-managed work group members versus traditional job holders regarding enhanced organizational involvement and enhanced work responsibility. However, there was no evidence of an age effect nor interaction regarding age. This study provides evidence to other action researchers and organizational decision makers that an "older" work force should not be considered a barrier to implementing this type of work design
Date: August 1992
Creator: Miller, Carolyn
System: The UNT Digital Library
The Self-Managed Work Team Environment: Perceptions of Men and Women (open access)

The Self-Managed Work Team Environment: Perceptions of Men and Women

The present study empirically examined working behaviors of men and women within a self-managed working environment. Three models of women and work were studied. Results indicated women exhibited higher levels of job meaning and continuance commitment. The more self-managed production team exhibited higher levels of growth need strength, support from co-workers, continuance commitment, task significance and lower levels of role conflicts. Support teams exhibited higher levels of autonomy and satisfaction with pay. Path analysis, testing a model based on Astin's sociopsychological model indicated direct effects from expectancy to general satisfaction, from gender to expectancy, and task significance to gender. An alternative model showed direct effects between general satisfaction and expectancy, satisfaction with pay, task significance and expectancies, and between satisfaction with pay and teams.
Date: August 1992
Creator: Martins-Crane, Lolin
System: The UNT Digital Library
The Angoff Method and Rater Analysis: Enhancing Cutoff Score Reliability and Accuracy (open access)

The Angoff Method and Rater Analysis: Enhancing Cutoff Score Reliability and Accuracy

At times called a philosophy and other times called a process, cutting score methodology is an issue routinely encountered by Industrial/Organizational (I/0) psychologists. Published literature on cutting score methodology appears much more frequently in academic settings than it does in personnel settings where the potential for lawsuits typically occurs more often. With the passage of the 1991 Civil Rights Act, it is no longer legal to use within-group scoring. It has now become necessary for personnel psychologists to develop more acceptable selection methods that fall within established guidelines. Designating cutoff scores with the Angoff method appears to suit many requirements of personnel departments. Several procedures have evolved that suggest enhancing the accuracy and reliability of the Angoff method is possible. The current experiment investigated several such procedures, and found that rater accuracy methods significantly enhance cutoff score reliability and accuracy.
Date: December 1993
Creator: Baker, Charles E., 1957-
System: The UNT Digital Library