
1997-1998 Department-Based Assessment:
Summary Report
Department of Mechanical Engineering
Ohio University
Robert L. Williams II, Ph.D. June 1998
This report details the results of the Department of Mechanical Engineering third years experience with outcomes-based assessment. As with previous years, the purpose of assessment is to improve undergraduate teaching, learning, and student services.
1. Department Goals
The first section presents our general Vision, Mission, Objectives, and Strategies statements. This section concludes with statements of our department-based assessment goals, both current and future.
1.1 Vision
We are a department committed to the education of productive Mechanical Engineers (both Undergraduate and Graduate) and to conducting high quality research.
1.2 Mission
We will attract, educate, and train talented men and women to enter the field of Mechanical Engineering and prepare them for productive careers in professional practice. We will also attract external funds to conduct high quality research.
1.3 Objectives
1.4 Strategies
1.5 Outcomes-Based Assessment Goals
1.5.1 Current
Our current goals for successful graduates are:
1.5.2 Future
The above goals are still sound and pertinent. However, in the future we will integrate these goals with the following list, taken from the ABET Engineering Criteria 2000 document. These strongly resemble the North Central Association assessment criteria.
Our graduates will have:
The Department of Mechanical Engineering (ME) of the Russ College of Engineering & Technology at Ohio University uses a variety of assessment vehicles for feedback regarding the effectiveness of our program:
These various feedback sources are monitored continuously and used to improve Mechanical Engineering curriculum and instructional practices. Program improvements can be both individual (professor improving specific course based on one or more feedback sources) and global (e.g. major re-working of senior design sequence based on industrial feedback and outcomes-based ABET accreditation criteria).
Internal assessment feedback includes (the first two include hardware components and often industry-motivated problems):
From the recent April 1998 meeting of the ME Advisory Board, all members expressed satisfaction with the quality of our graduates and progress toward our goals. This group cautioned not to change too much too fast because of our current strong position in providing capable engineers for industry. The Advisory Board is a diverse group of practicing engineers and managers, composed of OU ME graduates who are in positions of authority in industry. Attached to this report please find a copy of the Advisory Boards summary letter for this year. This letter demonstrates a high level of satisfaction regarding our program amongst our diverse industrial advisors:
Mr. Terrence E. Russell, P.E., Chair Mr. Donald Lomax
General Electric Corp. Lomax Realty
Oregonia, OH Wales, WI
Dr. Tom Wakeman, P.E. Mr. Robert Giffen, P.E.
General Electric Corp. Grimes Aerospace
Schenectady, NY Columbus, OH
Dr. H. Gregory Rigo, P.E. Mr. Craig R. Love
Rigo and Rigo Associates Chrysler Corp.
Berea, OH Bloomfield Hills, MI
Mr. Russel C. Tipton, P.E. Dr. James Malas
Liebert Corp. Wright Laboratories
Columbus, OH WPAFB, OH
Approximately one-third of our senior students take the standardized Fundamentals of Engineering (FE) examination (the first step for professional registration) prior to graduation. Attached to this report is a graph comparing the Ohio University ME students pass rate compared to state and national averages. As the graph shows, our departments students have demonstrated higher passing rates during the past two years. In all years shown, the ME students pass rate has steadily increased. All senior students are required to take and pass the locally-ME-administered mini-FE exam prior to graduation. This mini-FE exam mimics the official exam for initializing professional registration. These two exam results speak well for our students grounding in the fundamentals of Mechanical Engineering. Consistently, our students have the highest pass rate of any engineering major at Ohio University, as shown in the second attached graph.
Many of our undergraduate students are enrolled in the Co-op Program where students alternate quarters of school and work in industry. Not only is this valuable experience for the Co-op student, but it provides an excellent source of early outcomes-based feedback for our program. This feedback takes two forms: 1) Co-op student reports concerning their quarterly assignments, their employers, and their current level of preparation to meet the challenges presented to them; and 2) Employer reports evaluating the effectiveness of the co-op students in their assignments. The first table below shows that our percentage of students enrolled in the Co-op Program has steadily increased. The ME department has the largest number of Co-op students, in all years below (data available from the Co-op office, Ms. Marty North). The second table below shows the number of inidividual Co-op students in the program and the number of quarters worked in industry by year. We value the contribution of these Co-op students to our program and assessment; our goal is to increase the active Co-op students to 50% in the short-term and to sustain this level.
Active Engineering Co-op Students (percentages of total students):
Academic Year |
1991/92 |
1992/93 |
1993/94 |
1994/95 |
1995/96 |
1996/97 |
Mechanical Engineering |
11 |
14 |
19 |
29 |
32 |
31 |
Engineering College Average |
8 |
11 |
12 |
18 |
19 |
20 |
Number of Co-op Students and Co-op Academic Quarters
Academic Year |
Number of Students |
Number of Quarters |
1997-98 |
55 |
83 |
1996-97 |
64 |
97 |
1995-96 |
70 |
106 |
1994-95 |
60 |
93 |
1993-94 |
40 |
65 |
1992-93 |
27 |
40 |
For the most recent two quarters where data is available, the next table gives Employer ratings of our Co-op students. This data is very encouraging in assessing our effectiveness. According to Dr. Alam, the ME Co-op advisor, these external Employer evaluations are typical of the last several years.
Employer Ratings of ME Co-op Students (Winter 1998, number of students):
Quarter |
Outstanding |
Very Good |
Average |
Marginal |
Unsatisfactory |
| Winter 1998 | 10 |
13 |
0 |
0 |
0 |
| Fall 1997 | 4 |
6 |
0 |
0 |
0 |
Permanent employment feedback also forms valuable external assessment feedback to our program. Recently Mr. Don Hart of The Timken Company and Dr. Tom Wakeman of General Electric Company expressed satisfaction with the OU ME graduates they have hired and both expressed interest in hiring more in the future.
Our next ABET accreditation occurs in Fall 1998, under the existing rules. However, in the year 2000, ABET will shift to outcomes-based accreditation. Therefore, we are making plans (in conjunction with this yearly outcomes-based assessment) to comply early with this future change.
This is our third year of outcomes-based assessment and we are focusing on evaluating how our assessment vehicles are performing in achieving our department goals. We recognize the need for better data, based on actual graduate outcomes. An immediate goal is to maintain a database of all graduating seniors. Also, we are collecting and maintaining a folder of business cards from our graduates currently working in the field, from all possible years. As a first step, we have obtained the complete list of 1,360 BSME graduates from Ohio University, with addresses and employment information.
The following two tables summarize outcomes-based data from the Mechanical Engineering Career and Further Education and Mechanical Engineering Five-year Educational Outcomes, respectively.
From the Mechanical Engineering Career and Further Education results (percentages):
1991 |
1992 |
1993 |
1994 |
1995 |
1996 |
|
Employed |
91 |
69 |
91 |
82 |
87 |
85 |
Enrolled in Graduate Study |
25 |
25 |
24 |
31 |
8 |
30 |
Professional Certification (or pursuing) |
-- |
75 |
55 |
62 |
69 |
45 |
OU Education Prepared Very Well |
80 |
50 |
73 |
53 |
62 |
89 |
From the Mechanical Engineering Five-year Educational Outcomes (percentages):
1986/87 |
1988/89 |
1990/91 |
|
Average Salary > $42,000 |
52 |
68 |
63 |
Employed |
96 |
100 |
100 |
Obtained Masters Degree |
7 |
16 |
16 |
Extremely Satisfied, Quality of Instruction |
39 |
60 |
81 |
Major Courses Helpful |
96 |
97 |
100 |
The results of these two tables are encouraging in our outcomes-based assessment. A high percentage of our graduates are employed in industrial jobs. A significant number have obtained or are pursing masters degrees and professional certification (not required for all jobs). We would like to increase graduate satisfaction in terms of being extremely satisfied with the quality of instruction and feeling that their Mechanical Engineering education prepared them very well for their careers; as shown in the top table, this number is increasing for our department over the last three years.
The following figure graphically summarizes item #11, Competencies Needed and Developed, from the Mechanical Engineering Five-year Educational Outcomes data. For 14 major areas, this data describes the degree to which OU Mechanical Engineering graduates feel each area is needed and also how well their OU education prepared them for that specific area. The solid lines plot the averages; data falling in the upper right quadrant are the areas which are needed and we are doing a good job providing. Data in the lower left quadrant are the areas which are not needed (according to our graduates, not according to the ME department) and we are not doing a good job providing. The primary area of concern is the upper left quadrant, areas which our alumni perceive are needed but not being effectively provided by our department. From the five year survey data, 1986-1991, there are two areas which fall into this problem category: 1) Sensitivity to feelings and perceptions of others; and 2) Organize and supervise work of others. Our department needs to work on these shortcomings. For the four items in the lower-left quadrant, our graduates perceive that these are not important and that we are not doing a good job providing them. We believe that if we improve our efforts in these areas, our graduates may start to perceive them as important and these items will move towards the upper right quadrant. We especially wish to change the low position of Cope With Ethical Issues. The eight elements in the upper right quadrant demonstrate our departments and Ohio University curriculums effectiveness in these important areas. These tend to be clustered in the upper corner, where we want them to remain in the future. Overall, the results from Competencies Needed and Developed indicate we are doing very well in preparing students for industrial jobs in Mechanical Engineering and related fields.
The following data indicate ME student enrollment and graduation trends over the review period:
ME Enrollment Data
Academic Year |
New Freshmen Enrollment |
Total Enrollment |
Number Graduated |
1996-97 |
49 |
251 |
49 |
1995-96 |
62 |
257 |
42 |
1994-95 |
59 |
257 |
39 |
1993-94 |
65 |
266 |
32 |
1992-93 |
73 |
255 |
30 |
As can be seen, total enrollments have remained relatively steady while the number of students completing the program has increased significantly. Freshman enrollments have declined slightly; however, these data do not include the "undecided engineering" students, the number of which has increased significantly during the review period. The Department has begun more active recruiting to attract new freshmen. This includes an annual "phonathon" wherein members of ASME contact prospective students by phone to discuss the ME program, and frequent visits by prospective students and their families.
3. Improvements/Enhancements/Developments
Four curriculum changes have recently been proposed or accomplished as a result of external and internal assessment feedback.
4. Future Plans
In addition to maintaining our current efforts in curriculum and assessment, the following future plans are presented to focus on outcomes-based assessment.
4.1 Curriculum
ME 100 will continue to be taught to our freshman students so they may have earlier contact with ME faculty, an introduction to design and analysis techniques, and industrial involvement through guest speakers and field trips.
The current nine credit hour senior design effort will be reworked into a three-quarter sequence to serve as our capstone design sequence. The purpose for the change is to: 1) give all students extensive design experience including hardware; 2) include regular deadlines, including the need for written and oral intermediate reports; and 3) provide a unified, competition-driven design course sequence lasting three quarters.
4.2 Assessment
As larger numbers of our students enter the Co-op program, the student and employer reports will become increasingly important sources of external assessment feedback. The benefit of this mode is that current students may not only assist in changing our programs, but may themselves profit before graduation.
The ME curriculum, seven-year review, ABET accreditation, and outcomes-based assessment committees will be integrated. This will be accomplished to share assessment feedback efficiently and to facilitate implementing changes in a responsive and timely fashion.
The ME department has now added twelve questions to the standard Ohio University Career and Further Education Study for our graduates only. The purpose is to provide detailed outcomes-based data specific to our department program. This survey addendum, written by Chuck Rich and the author, has been sent out for the first time during Spring 1998, so we expect to report our first data from this effort next year. The ME department believes that an ME-specific addendum would be more effective in the Five-Year survey, but currently the Ohio University Office of Institutional Research only offers this service for the One-Year survey.
In summary, current external feedback evidence points to success in producing strong ME graduates. Several curricular changes are in progress to meet needs based on previous feedback. We are in the process of shifting our assessment paradigm to external outcomes-based assessment. The ME advisory board, industrial employers, and Co-op students and employers are valuable external feedback resources