Assessment Report
Department of Biological Sciences
June 1998
The Department of Biological Sciences has endeavored to maintain high quality instructional programs and research activities throughout a year during which the department was being divided between two colleges. The inevitable tension within faculty and between colleges made 1997-98 an almost unbearable year, and it has taken an enormous toll in faculty morale and energy. Having made this point at the beginning, this report summarizes our progress, and does not dwell on our defeats, which are entirely beyond our control. It describes goals, processes we have used to assess accomplishment of the goals, analysis of data and identification of strengths and weaknesses, evidence for or against accomplishment of the goals, improvements and enhancements we have made, and recommendations of future changes in academic programs and assessment processes.
Departmental Goals
Departmental goals remain as they were stated in 1997. These are as follow.
Undergraduate. The department’s goals for its undergraduate majors are three-fold. Firstly, we aim for our students to gain a broad base of general knowledge, focused particularly in the biological sciences, and capped with in-depth knowledge specific to their particular major program. We expect our students --regardless of major program -- to be biologists, with a breadth of knowledge across the sub-disciplines to enable our graduates to communicate and appreciate biological sub-disciplines other than their specific major. Our second goal is that our students have broad knowledge in humanities, mathematics, social sciences, and natural sciences, coupled with analytical, oral and compositional skills, to promote good citizenship and the capacity for life-long learning. Finally, our goal is to prepare our students with sufficient depth of knowledge in their specific major programs to assure successful employment in the field, successful entry and completion of graduate and professional schools for advanced study, and to have a high level of satisfaction with the preparation they received in their major.
Graduate. The department’s goals for its graduate students are for them to have a depth of knowledge in their area of specialization sufficient to enable them to be successfully employed in their field and to function as a mature and independent scientists. Toward this end, our goal is to assure that our graduate students have sophisticated skills in designing and conducting scientific experiments, excellent analytical skills appropriate to the specialization area, and excellent authoring experience in the scientific literature. Our goals include preparing graduates sufficiently that they are employed in doctoral and research universities as tenure-track faculty and professional scientists or industrial research scientists and that they have a high level of satisfaction with their graduate program.
Goal Development. These goals have been developed over the past decade by several groups of faculty representing the department’s curricular and research focus groups. These groups have been charged by the current and previous department chairs with addressing curricular issues and outcome success issues that our internal assessments have brought to our attention. Small group recommendations are taken to all the faculty at departmental meetings for discussion and modification by the entire faculty. There is broad, but not total, agreement among department faculty about each of the above goals. The greatest degree of tension resides in the portions of the goals that deal with curricular breadth both within and without biological sciences per se; however, a strong majority of the faculty of this department supports the stated goals.
Recent Changes in Departmental Goals. None since 1997.
Assessment of Student Learning
Testing Instruments, Methods, and Processes Used to Collect Assessment Data. A variety of assessment methods, including both quantitative and qualitative processes, are being used to determine whether our goals are being met.
At the undergraduate level, quantitative methods include performance on the Medical College Aptitude Test (MCAT) and the Graduate Record Examination (GRE). Both of these tests are administered nationally, and both provide invaluable information about the preparedness of our students at the beginning of their senior year. Additionally, both are valuable because many students from all of our major areas of study take both examinations each year, thereby giving us an across-the-board objective assessment of what our students know at that stage of their studies. However, for practical reasons, we can rely only on the MCAT at present because we get a complete report of the scores our students earn on this test, but we have been unable to obtain such complete reporting concerning the GRE. Additionally, we have strong objective data from the Association of American Medical Colleges (AAMC) on matriculation of our students into allopathic medical schools each year. This is a further measure, across-the-board, of the preparedness of our students mid-way through their senior year.
Qualitative methods employed in assessing success in meeting our goals for our undergraduate students include reports (Career and Further Education Study and the Long-term Educational Outcomes Study) from Ohio University Institutional Research, direct feedback from graduates, and the quality of the professional and graduate schools into which our students are admitted.
At the graduate level, we rely on statistical data which include the number of peer-reviewed papers published, the number of papers given at meetings, the mean time to complete the degree, and success in finding employment or further education as objective measures of success in meeting our goals for our graduate students. Qualitative measures include teaching evaluations and awards received by our students, and periodic questionnaires for our graduates to complete.
Both graduate and undergraduate students tell us that they are most appreciative of the education and opportunities they have gained from the department and we rely on this information as a gauge of how well are students are being served. This year, the feedback that we have received from students in graduate and professional schools, as well as from faculty at these institutions, has been especially frequent and laudatory.
We have not altered our methods since last year.
Data Analysis and Diagnosis of Strengths and Weaknesses
The Medical College Aptitude Test (MCAT) is taken by all students who are applying to medial schools and some other types of professional schools. Because students in several of our majors take this test and because it is designed to test general knowledge as well as knowledge specific to biological sciences, it is very useful as an overall indicator of how well our students are being educated in our programs. The department receives MCAT scores for each Ohio University student who takes the test, as well as means for students across the university and the nation. Each year we can follow the success of our own students against the university and national averages. The data also allow us to delineate among general categories of subjects, including verbal ability, physical sciences, writing, and biological sciences. Our goal is for our students to outperform the national average in each category. Additionally, because we have records on this test for many years, we can determine whether changes are occurring and in which direction for each category, as well as the overall score. We would consider a downward drift of scores by our students, especially in comparison with the national means, to be a major area of concern, and conversely, a consistent upward movement of our students’ scores would be evidence that we are making progress toward our goals.
In similar fashion, we receive a complete listing of applicants from Ohio University who have applied to a college of allopathic medicine. We also are informed as to which school, if any, an applicant has been admitted. We are supplied with data on the national applicant pool with summaries of the numbers of applicants and the successes they have nation-wide. These data allow us to determine the success rate of our students in comparison to national trends. We have these data for many years, and we can observe changes in the successes of our students in comparison to the national trends, and in correlation with MCAT scores and GPAs. As in the case with MCAT scores, a downward change in our students’ acceptance rates versus the national mean would be cause for concern, while an upward shift would be evidence for progress.
Results from Ohio University Institutional Research, likewise, are available over a period of many years. We can compare the results for more recent graduates with those from previous classes, and we can compare the results for our graduates with those across the College of Arts and Sciences and the entire university. We focus on several summary statistics from these reports. In particular, we track the employment rate of our graduates, the length of time to become employed, average salaries, satisfaction with major courses, how well they were prepared for their career goals, and how well they were prepared for additional academic work. We also use the long-term educational outcomes results to assess graduates’ satisfaction with their academic preparation five years after graduation. We analyze these data for evidence that graduates are not satisfied with any aspect of their experiences at Ohio University, and we note any changing patterns occurring over a span of several years. Dissatisfaction rates greater than 10% concern us, as do downward shifts in satisfaction rates. Conversely, satisfaction rates of greater than 90% are indications that we are making progress toward our goals.
For our graduate programs, we note whether students completing degrees publish their thesis or dissertation results in peer-reviewed papers within one year of completing their degrees. We expect all of our Ph.D. graduates to have met this goal and 67% of our M.S. graduates to have met the goal. We expect that each graduate student will have presented a minimum of one research presentation at a scientific meeting before he or she is graduated. Our goal is for all graduate students to be employed within three months of graduation or to be enrolled in further educational pursuits. All of our graduate students must teach during their program of study, and each course is evaluated by the students taught. Our goal is to have our graduate TA’s earn high scores from the students they teach, and if a student earns below average scores, they are counseled to help them improve their scores. In our periodic questionnaires, we seek information on the satisfaction students have with their program, the degree to which they perceive it prepared them for them career aspirations, and suggestions for changes that should be made in the graduate program. Satisfaction rates under 90% are considered significant reasons for concern.
Evidence Indicating Accomplishment of Goals and Evidence of Failure to Achieve Goals
Undergraduate
|
MCAT |
Ohio University |
U.S. |
|||
|
Category |
1991 |
1997 |
1991 |
1997 |
|
|
Verbal |
7.3 |
7.6 |
7.9 |
7.8 |
|
|
Physical Science |
6.2 |
7.7 |
7.7 |
8.1 |
|
|
Writing |
6.7 |
7.1 |
7.0 |
7.0 |
|
|
Biological Science |
6.2 |
8.2 |
7.8 |
8.4 |
|
M.S. Students:
Six students completed the masters degree program
Average length of time to complete the program was 2.5 years
Presentations: Five of six students presented at least once at a conference (total of 7 presentations)
Publications: Three of the six students were an author of an accepted manuscript (total 4 manuscripts)
Current activities: two are in doctoral programs, one is enrolled in medical school, one is employed in industry, one is applying to veterinary school, and one is not employed in the field.
Ph.D. Students:
Seven students completed the doctoral degree program
Average length of time to complete the program was 5.3 years
Presentations: All but one of these students presented at least once at a conference (the range was 0-5 presentations per student and the total was 20 presentations)
Publications: Each of the seven graduates is an author of an accepted manuscript (total 12 manuscripts) at this point.
Current activities: All are employed in their fields. Five have post-doctoral fellowships (including CDC, U. Pittsburgh, Case Western), one is an MBA student, and one is a research scientist at a biotechnology firm.
Improvements or Enhancements implemented due to Assessment Activity
Changes in the Undergraduate Program.
No Changes were made since last year.
Changes in the Graduate Program.
The merger of the Doctoral Program in the Department of Environmental and Plant Biology with the Department of Biological Sciences, as mandated by the Ohio Board of Regents, was accomplished last year. As with any merger there were a number of minor issues that arose that were resolved with improved communication. The post-merger admissions process proceeded more smoothly this year, and faculty and new students are adjusting well to the merger.
With a large segment of the Department of Biological Sciences being split off to form the new Department of Biomedical Sciences in the College of Osteopathic Medicine, there was concern about how this could affect the Graduate Program. Meetings between members of the two departments have been held to identify issues and possible resolutions. There is general agreement that the impact on the Graduate Program should be minimal, but creation of a policy document between the two departments will have to wait until certain budgetary and academic issues are formally resolved by the Deans of the two colleges.
Greater financial support for travel for graduate students to conferences is being provided in response to our external doctoral review committee report in 1995. The department provided funds to support 21 graduate student presentations at meetings. Three students presented at International Conferences outside the United States.
To improve communication with the graduate students an e-mail address list of all graduate students was compiled.
Although most of our graduate students receive high ratings from students they teach and from the faculty mentor for each course, some do not. The new TA assessment process developed last year and implemented this year has allowed us to isolate better these unsatisfactory cases. It was decided this year that students with unsatisfactory evaluations should get a letter of concern from the graduate committee with the threat that continued unsatisfactory evaluations could cause loss of support. Suggestions for improving teaching performance including making use of the resources of the Center for Teaching Excellence are also made to these students.
The results of this year's graduate admissions process are as follows:
190 applications (partial + complete) were received by the department
83 complete applications were received (plus 13 PBIOS doctoral)
22 students were admitted including 6 PBIOS candidates (27% BIOS, 46% PBIOS)
14 of 22 students offered acceptance will attend Ohio University (64%: 9 of 16 BIOS,
5 of 6 PBIOS)
All 14 new students will be funded as teaching or research assistants
Quality of students continues to be high. Average undergraduate GPA is up and the average GRE scores increased 0-12 percentage points in every category over last year.
Admitted doctoral students (n=16)
Undergraduate GPA: 3.6
Graduate GPA: 3.6
GRE scores: verbal: 79%, quantitative: 75%, analytical: 71%
TOEFL (n=5) 633.
Admitted masters students (n=6)
Undergraduate GPA: 3.4
Graduate GPA (n=1): 3.5
GRE scores: verbal: 71%, quantitative: 72%, analytical: 64%
TOEFL (n=2) 627.
These data indicate that our graduate programs are meeting our objective goals at present. Furthermore, this has been the case over the past six years.
Future Changes
Academic Programs and Curriculum. We continue to work toward establishment of a molecular, cellular, and developmental biology concentration at both the graduate and the undergraduate levels. This is arising out of our assessment that we are not offering our undergraduates enough cellular and molecular biology, and from the recommendations of the external doctoral review committee that we enhance our graduate concentration in developmental biology by introducing more molecular biology in that area. Likewise the team suggested that we add molecular biology in our muscle biology-exercise physiology area, and we hope to be able to do that in the near future.
Although our students have improved their writing scores, we know that we need to emphasize writing more in our curriculum. We currently include writing (term papers, essays, and reports) in most of our upper level classes, but we need to do more. We will continue to stress, among the faculty, the need for more writing and support efforts to enhance writing across the curriculum at Ohio University.
We will need to identify the reasons why approximately one-third of our recent graduates are not satisfied with our major courses. We will attempt to gain the answers by questionnaires to be mailed to recent graduates. Once identified, we will try to eliminate the causes of dissatisfaction if possible.
We must continue to monitor the MCAT scores of our students and seek ways to help them score higher on the test, either through changes in courses or changes in scheduling courses or examinations near the time students must take the MCAT.
Changes in Assessment Processes. It is imperative that we get better data on the GRE scores of our students. We still have not been able to find a way to gather these data, yet they are potentially very important to our assessment process.