Outcomes Assessment
Department of Classics
June, 1998
I. Unit goals for student learning.
Mission. The Classics Department teaches a diverse range of courses: Elementary instruction in Latin and Ancient Greek; Advanced literature courses in these languages; Courses in translation in the literatures and culture of the Romans and ancient Greeks; Courses in the archaeology of the Mediterranean world.
Our pedagogical mission is similarly complex. All classes taught in the Department aim to convey: (1) Skills; (2) Knowledge; (3) Appreciation for the Humanities. This is what we mean by each of these terms:
Assessment. The nature of each of the goals, (1) Skills, (2) Knowledge, and (3) Appreciation for the Humanities, is distinct; accordingly, the methods of assessing each must similarly be distinct.
Important Note. We must emphasize that, while it is the most difficult goal to measure, the cultivation of a humanistic approach to thinking may be the Department's most important goal. We wish to register our concern that the assessment process not undermine the pursuit of this important goal because it is difficult to assess it quantitatively or objectively.
II. Assessment Methods and Practices.
Systematic Assessment. Assessment of skills and knowledge through class participation, examination, and performance on papers and research projects is thoroughly systematic. Teaching is also systematically evaluated through quantitative and qualitative student evaluations.
Multiple Measures of Assessment. The description of the variety of methods used to assess different types of student learning indicates that the Department uses multiple measures of assessment. Multiple measurement is also implied in the regular rotation of most courses among the faculty. No student is likely to have only one professor for all courses in a given language, or all of his or her courses in classical literature, culture, or archaeology.
Most of this assessment is summative, occuring within the context of course work or at the conclusion of the program. We must also note that the Department is fully engaged in formative assessment that occurs outside the context of course work and that is directed to the Classics program as a whole. This assessment includes (1) Regular meetings of the Discipulorum Concilium (Student Council), an informal but regular lunch-time discussion between students (majors, minors, and those engaged in significant course work) and faculty; (2) Regular and intense Departmental discussion of the curriculum and our goals. This Department meets as a group to develop its curriculum through faculty discussion and dialogue.
Finally, we have an external index of our effectiveness in the success our students have in their acceptance to graduate school and professional school, and their success in the competition for scholarships and fellowships. As much as our students' cooperation will allow, we also intend to acquire another such external check by keeping a record of our students' performance on standardized tests such as the GRE and the LSAT.
Important Note. It ought to be noted that under the auspices of an 1804 Grant the Classics Department has initiated a significant curriculum reform using the seminar and dialogue as a means of course development and self-critique. We are concerned that this process not be dismissed as "anecdotal." Faculty dialogue is an indispensible method of program assessment.
III. Strengths and Weaknesses.
Diagnosis of Strengths and Weaknesses. In general our student evaluations and external checks such as performance on standardized tests, acceptance to graduate school and professional school, and success in the competition for scholarships and fellowships, all suggest that we are on target for our Departmental goals. However, through these evaluations, through dialogue with students, and through faculty dialogue we have identified two areas of weakness: (1) The elementary Latin program has used a text which is too demanding for the majority of our students, who are taking Latin to fulfill the language requirement. We are switching to a text that is better calibrated to the needs of this majority. (2) On the advice of our students and as a result of our own discussions we will encourage more active use of Latin and Greek, including composition in the languages and oral communication. (3) There are too few courses that address the most important aspect of our mission, cultivation of a humanistic approach to thinking. Accordingly we have met as a Department to develop CLAS courses that emphasize the humanistic approach.
Use of Comparative Data. Comparison of data has been made possible within the Department through the rotation of faculty. Students in each of our sub-disciplines are evaluated by a number of different professors. Comparison of data relative to other faculty in the College of Arts and Sciences is made possible through our use of the College's standardized student evaluation form. Finally, comparison of data relative to students at other institutions is made possible through their performance on standardized tests such as the GRE and the LSAT, acceptance to graduate school and professional school, and their success in the competition for scholarships and fellowships.
However, it must be emphasized that discussions between faculty and students and faculty and faculty played a significant role in identifying the need for change in the Latin program and the Departmental curriculum revision. Again, it must be emphasized that for this relatively small department discussion and dialogue take precedence over standardized data in assessement.
Faculty Involvement. It should be clear that all Classics faculty, including adjuncts, are significantly involved in all areas of course, program, and student assessment.
IV. Evidence of Unit Goals Being Accomplished
Accomplishment of Goals.
The weakness inherent in appraising student skills and knowledge by the judgment of individual faculty is that those faculty may or may not have good judgment. We are confident of our faculty's judgment, in the first place, because we know one another's minds and because our small student base allows us to compare/contrast our judgment of specific students. By way of confirmation we are pleased that to the degree that assessment of our program occurs from outside the university, it has been uniformally positive.
The most obvious form that outside appraisal takes is when excellent graduate schools accept the students we recommend to them and agree that our assessment of those students was on target. Students from other schools (Berkeley, University of Chicago, and University of Victoria, Canada) have commented on the effectiveness of this Department's approach to teaching Greek. During the past 5-10 years we have recommended a number of majors (declared or undeclared) and minors to graduate programs. We recommended some of those students to masterís programs at good universities. A few we have recommended to Ph.D. programs at first-class institutions like Chapel Hill and Chicago. Without exception our students have been accepted to the sort of program we recommended them (with financial aid), and subsequent feedback from the graduate schools has indicated that those schools believed that we had fairly represented our students to them. One might say that this measure is anecdotal, but given the small sample of our majors we believe that anecdotal evidence is more telling than statistical analyses would be.
V. Improvements based on assessments.
Implementation of improvements based on assessment. Discussions among faculty and students have led us to make modest revisions in our elementary Greek and Latin curricula. Professor Hays is re-writing his elementary Greek text to involve students in more writing and oral-aural activities. The faculty have also decided to adopt a different Latin text. And, we have decided to increase the role of composition in upper-division courses in both Greek and Latin.
In addition, the entire faculty, encouraged and supported by an 1804 grant, are working to develop a new series of Classical Humanities courses that we think will broaden the enrollment base in Classics and that will more directly address the department s goal to encourage overtly humanistic learning.
In all fairness, we must state that these improvements were based on the kind of assessment that has always served this Department well: interaction among ourselves and with our students. The actual data that motivated our decisions are largely (but not entirely) qualitative and depend significantly on faculty dialogue and interactions with students. Some examples: faculty members observe that even good students in Greek exhibit linguistic weaknesses that they determine can best be remedied by more active learning methods; excellent Classics students who have studied both Greek and Latin report that the Latin text is uninspiring; faculty in conversation with one another and with colleagues at other institutions conclude that the Humanities in general lack clear direction and conclude that we should inaugurate a new series of Classical Humanities courses.
So, the Classics Department has been busily engaged in continuous improvement during the 1997-8 academic year just as it has been since at least the mid-1980 s. We can point to three specific major areas of improvement that we are engaged in. The truth is that these change arose independently of the University's demands for departmental Assessment Reports.
VI. Recommended Changes.
Changes in Program and Curriculum. If the changes in the elementary Greek and Latin curricula are successful in improving student performance, an opportunity will develop to ratchet up the expectations for second-year and more advanced students in both languages. It is likely that we will begin to turn our attention to refining the intermediate and advanced language curricula as we see how students respond to the changes we will implement in the fall of 1998. In part as a result of the strongly positive student feedback on the academic quarter in Greece, we are developing a Winter intersession program in Rome.
The immense work we have done in shaping the new Classical Humanities courses will need to be followed up with even more work in refining those courses. In addition, we are determined to involve numerous faculty in co-teaching arrangements so as to broaden the faculty's teaching repertoire.
Changes in Assessment. We intend to develop exit interviews of our graduating majors, minors, and other students that have done significant course work in the Department for the purposes of summative program assessment and to provide an index of our effectiveness in communicating the broader lessons of the Humanities. We are also now developing a real alumni base that will enable us to develop a systematic means of staying in touch with alumni. We intend to continue to measure the the effects of the Humanities on our students' lives after they have graduated as well as perceptions of our program over time. Such surveys will add to the systematic collection of qualitative data. We also intend to collect more quantitative data by keeping a record of our students' performance on standardized tests such as the GRE and the LSAT and GPAs of our majors and minors.