It is hypothesized that useful diagnostic information can reside in the wrong answers of multiple-choice tests, and that properly designed distractors can yield indications of misinformation and missing information in algorithmic reasoning on the part of the test taker. In addition to summarizing the literature regarding diagnostic research as opposed to scoring research, this study proposes a methodology for analyzing test results and compares the findings with those from the research of Birenbaum and Tatsuoka and others. The proposed method identifies the conditions of misinformation and missing information, and it contains a statistical compensation for careless errors. Strengths and weaknesses of the method are explored, and suggestions for further research are offered.

Although the primary role of the computer has been in processing and analysis of survey data, it has increasingly been used in data collection. Computer surveys are not exempt from a common problem: some refuse to participate. Many researchers and practitioners indicate the refusal problem is less for computer surveys, perhaps due to the novelty of the method. What has not been investigated is the refusal problem when on-line surveys are no longer novel. This research study examines the use of one form of computer-assisted data collection, the electronic or on-line survey, as an organizational research tool. The study utilized historical response data and administered an on-line survey to individuals known to be cooperative or uncooperative in other on-line surveys. It investigated nonresponse bias and response effects of typical responders, periodic participants, and typical refusers within a sample of corporate employees in a computer-interactive interviewing environment utilizing on-line surveys. The items measured included: participation, respondent characteristics, response speed, interview length, perceived versus actual interview length, quantity of data, item nonresponse, item response bias, consistency of response, extremity of response, and early and late response. It also evaluated factors reported as important when deciding to participate, preferred data collection method, and …