For the past decade, the non-residential portion of California's Title-24 building energy standard has relied on DOE-2.1E as the reference computer simulation program for development as well as compliance. However, starting in 2004, the California Energy Commission has been evaluating the possible use of Energy Plus as the reference program in future revisions of Title-24. As part of this evaluation, the authors converted the Alternate Compliance Method (ACM) certification test suite of 150 DOE-2 files to Energy Plus, and made parallel DOE-2 and Energy Plus runs for this extensive set of test cases. A customized version of DOE-2.1E named doe2ep was developed to automate the conversion process. This paper describes this conversion process, including the difficulties in establishing an apples-to-apples comparison between the two programs, and summarizes how the DOE-2 and Energy Plus results compare for the ACM test cases.