mecheng.jpg (38645 bytes)

1997-1998 Department-Based Assessment:

Summary Report

Department of Mechanical Engineering

Ohio University

Robert L. Williams II, Ph.D. June 1998

This report details the results of the Department of Mechanical Engineering third year’s experience with outcomes-based assessment. As with previous years, the purpose of assessment is to improve undergraduate teaching, learning, and student services.

1. Department Goals

The first section presents our general Vision, Mission, Objectives, and Strategies statements. This section concludes with statements of our department-based assessment goals, both current and future.

1.1 Vision

We are a department committed to the education of productive Mechanical Engineers (both Undergraduate and Graduate) and to conducting high quality research.

1.2 Mission

We will attract, educate, and train talented men and women to enter the field of Mechanical Engineering and prepare them for productive careers in professional practice. We will also attract external funds to conduct high quality research.

1.3 Objectives

 

1.4 Strategies

 

1.5 Outcomes-Based Assessment Goals

 

1.5.1 Current

Our current goals for successful graduates are:

    1. Students will learn logical approaches to solving complex problems.
    2. Students will be capable of designing and developing all types of machines, mechanical systems, and energy systems.
    3. Students will have a broad range of technical knowledge in materials behavior, motion transfer, electricity and electronics, energy conversion, control theory, stress analysis, fluid behavior, and computer techniques.
    4. Students will be prepared with both theoretical and practical aspects of mechanical engineering.
    5. Students are expected to become proficient in developing mathematical models based on physical principles.
    6. Recipients of the M.S.M.E. degree will learn and demonstrate advanced knowledge of mechanical engineering.

 

1.5.2 Future

The above goals are still sound and pertinent. However, in the future we will integrate these goals with the following list, taken from the ABET Engineering Criteria 2000 document. These strongly resemble the North Central Association assessment criteria.

Our graduates will have:

    1. an ability to apply knowledge of mathematics, science, and engineering to real-world problems;
    2. an ability to design and conduct experiments, as well as to analyze and interpret data;
    3. an ability to design a system, component, or process to meet desired needs;
    4. an ability to function on multi-disciplinary teams;
    5. an ability to identify, formulate, and solve engineering problems;
    6. an understanding of professional and ethical responsibility;
    7. an ability to communicate effectively;
    8. the broad education necessary to understand the impact of engineering solutions in a global/societal context;
    9. a recognition of the need for and an ability to engage in life-long learning;
    10. a knowledge of contemporary issues; and,
    11. an ability to use the techniques, skills, and modern engineering tools necessary for engineering practice.
  1. Assessment Evidence

The Department of Mechanical Engineering (ME) of the Russ College of Engineering & Technology at Ohio University uses a variety of assessment vehicles for feedback regarding the effectiveness of our program:

These various feedback sources are monitored continuously and used to improve Mechanical Engineering curriculum and instructional practices. Program improvements can be both individual (professor improving specific course based on one or more feedback sources) and global (e.g. major re-working of senior design sequence based on industrial feedback and outcomes-based ABET accreditation criteria).

Internal assessment feedback includes (the first two include hardware components and often industry-motivated problems):

 

 

From the recent April 1998 meeting of the ME Advisory Board, all members expressed satisfaction with the quality of our graduates and progress toward our goals. This group cautioned not to change too much too fast because of our current strong position in providing capable engineers for industry. The Advisory Board is a diverse group of practicing engineers and managers, composed of OU ME graduates who are in positions of authority in industry. Attached to this report please find a copy of the Advisory Board’s summary letter for this year. This letter demonstrates a high level of satisfaction regarding our program amongst our diverse industrial advisors:

Mr. Terrence E. Russell, P.E., Chair Mr. Donald Lomax

General Electric Corp. Lomax Realty

Oregonia, OH Wales, WI

Dr. Tom Wakeman, P.E. Mr. Robert Giffen, P.E.

General Electric Corp. Grimes Aerospace

Schenectady, NY Columbus, OH

Dr. H. Gregory Rigo, P.E. Mr. Craig R. Love

Rigo and Rigo Associates Chrysler Corp.

Berea, OH Bloomfield Hills, MI

Mr. Russel C. Tipton, P.E. Dr. James Malas

Liebert Corp. Wright Laboratories

Columbus, OH WPAFB, OH

 

Approximately one-third of our senior students take the standardized Fundamentals of Engineering (FE) examination (the first step for professional registration) prior to graduation. Attached to this report is a graph comparing the Ohio University ME students’ pass rate compared to state and national averages. As the graph shows, our department’s students have demonstrated higher passing rates during the past two years. In all years shown, the ME students’ pass rate has steadily increased. All senior students are required to take and pass the locally-ME-administered mini-FE exam prior to graduation. This mini-FE exam mimics the official exam for initializing professional registration. These two exam results speak well for our students’ grounding in the fundamentals of Mechanical Engineering. Consistently, our students have the highest pass rate of any engineering major at Ohio University, as shown in the second attached graph.

Many of our undergraduate students are enrolled in the Co-op Program where students alternate quarters of school and work in industry. Not only is this valuable experience for the Co-op student, but it provides an excellent source of early outcomes-based feedback for our program. This feedback takes two forms: 1) Co-op student reports concerning their quarterly assignments, their employers, and their current level of preparation to meet the challenges presented to them; and 2) Employer reports evaluating the effectiveness of the co-op students in their assignments. The first table below shows that our percentage of students enrolled in the Co-op Program has steadily increased. The ME department has the largest number of Co-op students, in all years below (data available from the Co-op office, Ms. Marty North). The second table below shows the number of inidividual Co-op students in the program and the number of quarters worked in industry by year. We value the contribution of these Co-op students to our program and assessment; our goal is to increase the active Co-op students to 50% in the short-term and to sustain this level.

 

Active Engineering Co-op Students (percentages of total students):

Academic Year

1991/92

1992/93

1993/94

1994/95

1995/96

1996/97

Mechanical Engineering

11

14

19

29

32

31

Engineering College Average

8

11

12

18

19

20

 

Number of Co-op Students and Co-op Academic Quarters

Academic Year

Number of Students

Number of Quarters

1997-98

55

83

1996-97

64

97

1995-96

70

106

1994-95

60

93

1993-94

40

65

1992-93

27

40

 

For the most recent two quarters where data is available, the next table gives Employer ratings of our Co-op students. This data is very encouraging in assessing our effectiveness. According to Dr. Alam, the ME Co-op advisor, these external Employer evaluations are typical of the last several years.

 

Employer Ratings of ME Co-op Students (Winter 1998, number of students):

Quarter

Outstanding

Very Good

Average

Marginal

Unsatisfactory

Winter 1998

10

13

0

0

0

Fall 1997

4

6

0

0

0

Permanent employment feedback also forms valuable external assessment feedback to our program. Recently Mr. Don Hart of The Timken Company and Dr. Tom Wakeman of General Electric Company expressed satisfaction with the OU ME graduates they have hired and both expressed interest in hiring more in the future.

Our next ABET accreditation occurs in Fall 1998, under the existing rules. However, in the year 2000, ABET will shift to outcomes-based accreditation. Therefore, we are making plans (in conjunction with this yearly outcomes-based assessment) to comply early with this future change.

This is our third year of outcomes-based assessment and we are focusing on evaluating how our assessment vehicles are performing in achieving our department goals. We recognize the need for better data, based on actual graduate outcomes. An immediate goal is to maintain a database of all graduating seniors. Also, we are collecting and maintaining a folder of business cards from our graduates currently working in the field, from all possible years. As a first step, we have obtained the complete list of 1,360 BSME graduates from Ohio University, with addresses and employment information.

The following two tables summarize outcomes-based data from the Mechanical Engineering Career and Further Education and Mechanical Engineering Five-year Educational Outcomes, respectively.

 

From the Mechanical Engineering Career and Further Education results (percentages):

 

1991

1992

1993

1994

1995

1996

Employed

91

69

91

82

87

85

Enrolled in Graduate Study

25

25

24

31

8

30

Professional Certification (or pursuing)

--

75

55

62

69

45

OU Education Prepared Very Well

80

50

73

53

62

89

 

From the Mechanical Engineering Five-year Educational Outcomes (percentages):

 

1986/87

1988/89

1990/91

Average Salary > $42,000

52

68

63

Employed

96

100

100

Obtained Master’s Degree

7

16

16

Extremely Satisfied, Quality of Instruction

39

60

81

Major Courses Helpful

96

97

100

The results of these two tables are encouraging in our outcomes-based assessment. A high percentage of our graduates are employed in industrial jobs. A significant number have obtained or are pursing master’s degrees and professional certification (not required for all jobs). We would like to increase graduate satisfaction in terms of being extremely satisfied with the quality of instruction and feeling that their Mechanical Engineering education prepared them very well for their careers; as shown in the top table, this number is increasing for our department over the last three years.

The following figure graphically summarizes item #11, Competencies Needed and Developed, from the Mechanical Engineering Five-year Educational Outcomes data. For 14 major areas, this data describes the degree to which OU Mechanical Engineering graduates feel each area is needed and also how well their OU education prepared them for that specific area. The solid lines plot the averages; data falling in the upper right quadrant are the areas which are needed and we are doing a good job providing. Data in the lower left quadrant are the areas which are not needed (according to our graduates, not according to the ME department) and we are not doing a good job providing. The primary area of concern is the upper left quadrant, areas which our alumni perceive are needed but not being effectively provided by our department. From the five year survey data, 1986-1991, there are two areas which fall into this problem category: 1) Sensitivity to feelings and perceptions of others; and 2) Organize and supervise work of others. Our department needs to work on these shortcomings. For the four items in the lower-left quadrant, our graduates perceive that these are not important and that we are not doing a good job providing them. We believe that if we improve our efforts in these areas, our graduates may start to perceive them as important and these items will move towards the upper right quadrant. We especially wish to change the low position of Cope With Ethical Issues. The eight elements in the upper right quadrant demonstrate our department’s and Ohio University curriculum’s effectiveness in these important areas. These tend to be clustered in the upper corner, where we want them to remain in the future. Overall, the results from Competencies Needed and Developed indicate we are doing very well in preparing students for industrial jobs in Mechanical Engineering and related fields.

The following data indicate ME student enrollment and graduation trends over the review period:

 

ME Enrollment Data

Academic

Year

New Freshmen

Enrollment

Total

Enrollment

Number

Graduated

1996-97

49

251

49

1995-96

62

257

42

1994-95

59

257

39

1993-94

65

266

32

1992-93

73

255

30

As can be seen, total enrollments have remained relatively steady while the number of students completing the program has increased significantly. Freshman enrollments have declined slightly; however, these data do not include the "undecided engineering" students, the number of which has increased significantly during the review period. The Department has begun more active recruiting to attract new freshmen. This includes an annual "phonathon" wherein members of ASME contact prospective students by phone to discuss the ME program, and frequent visits by prospective students and their families.

 

3. Improvements/Enhancements/Developments

 

Four curriculum changes have recently been proposed or accomplished as a result of external and internal assessment feedback.

 

    1. ME 100 is now offered every quarter (started in Fall 1997). Previous to this course, we did not encounter our students until late in their sophomore year, when they take the service courses ME 224 and ME 321. Mechanical Engineering design, history, and techniques are introduced in ME 100. Matlab software is also introduced, based on feedback from previous student evaluations.
    2. The course contents of Physics 252 and 253 have been reversed (led by the ME department) so that engineering students may take CE 220, Statics, in proper sequence, with the appropriate Physics prerequisite.
    3. ME junior-level required courses are now being offered twice per year to accommodate Co-op students. The ME department values Co-op students and must facilitate their academic schedules. A side-benefit is smaller classes.
    4. The entire senior-level design sequence has been proposed for overhaul based on industry feedback. Currently a total of nine credit hours comprise ME 404 (Machine Design II, 4 credit hours) or ME 417 (Design of Thermal Systems, 4 credit hours), plus ME 499 (individualized senior design project, 4 credit hours) and ME 480 (Senior Colloquium, 1 credit hour). This nine credit hours will be re-worked into a three-quarter (three credit hours each) senior design course sequence where there is one major design project with hardware results. This major change will be implemented during the next academic year.
    5. Our department is offering various graduate courses in the OAI teleconferencing classroom for engineers in industry interested in pursuing a master’s degree. Also, we are collaborating with OSU in alternating the teaching graduate courses via the OAI electronic classroom.
    6. A Mechanical Engineering Honors Program has been implemented in order to involve undergraduate students in research projects (for credit) and to recruit top U.S. citizens for graduate study in our department.
    7. Improvements in written and oral technical communications are being pursued in many courses, based on industry feedback.
    8. The ME department led an effort to replace our students’ training in Cadkey with AutoCAD software for technical drawing and CAD/CAM. This change was motivated by external feedback from industry, Co-op employers, and internal feedback from students and faculty.

 

4. Future Plans

In addition to maintaining our current efforts in curriculum and assessment, the following future plans are presented to focus on outcomes-based assessment.

4.1 Curriculum

ME 100 will continue to be taught to our freshman students so they may have earlier contact with ME faculty, an introduction to design and analysis techniques, and industrial involvement through guest speakers and field trips.

The current nine credit hour senior design effort will be reworked into a three-quarter sequence to serve as our capstone design sequence. The purpose for the change is to: 1) give all students extensive design experience including hardware; 2) include regular deadlines, including the need for written and oral intermediate reports; and 3) provide a unified, competition-driven design course sequence lasting three quarters.

4.2 Assessment

As larger numbers of our students enter the Co-op program, the student and employer reports will become increasingly important sources of external assessment feedback. The benefit of this mode is that current students may not only assist in changing our programs, but may themselves profit before graduation.

The ME curriculum, seven-year review, ABET accreditation, and outcomes-based assessment committees will be integrated. This will be accomplished to share assessment feedback efficiently and to facilitate implementing changes in a responsive and timely fashion.

The ME department has now added twelve questions to the standard Ohio University Career and Further Education Study for our graduates only. The purpose is to provide detailed outcomes-based data specific to our department program. This survey addendum, written by Chuck Rich and the author, has been sent out for the first time during Spring 1998, so we expect to report our first data from this effort next year. The ME department believes that an ME-specific addendum would be more effective in the Five-Year survey, but currently the Ohio University Office of Institutional Research only offers this service for the One-Year survey.

In summary, current external feedback evidence points to success in producing strong ME graduates. Several curricular changes are in progress to meet needs based on previous feedback. We are in the process of shifting our assessment paradigm to external outcomes-based assessment. The ME advisory board, industrial employers, and Co-op students and employers are valuable external feedback resources

 

Back to Assessments