This study's purpose was to investigate the differences in scores and written comments given by two appraisal groups in their evaluation of a music teacher using the Texas Teacher Appraisal System (TTAS). One appraiser group had musical training while the other group specialized in other subjects. Analyses of both group's appraisal scores showed no significant differences. An examination of the written comments revealed that both appraisal groups focused on the same aspects of the lesson and used similar vocabulary. The TTAS instrument was a consistent measure of generic teacher behaviors in the music lesson, but it did not measure specific music teaching behaviors or encourage suggestions for improving musical instruction.