I. Goals of the School of Journalism in Respect to Student Learning
The overall goal of the School of Journalism is best reflected in the school's mission statement:
The E.W. Scripps School of Journalism is dedicated to the needs of its students; to excellence in teaching, advising, service, and research; and to leadership in journalism education. The school stresses the need for a liberal arts foundation combined with a professional education and practical experience for its students. The goals are to search for truth; to develop critical analysis, thinking, writing and speaking abilities; and to enhance free, responsible and effective expression of ideas. In order to carry out its mission statement, the School of Journalism:
The school also subscribes to the College of Communication Outcome Expectations: (1) skills in speaking, writing and computing; (2) breadth of knowledge; (3) critical thinking, gathering and analysis of information; and (3) completion of an internship or practicum.
In addition to these general expectations of students, each sequence in the school has specific expectations of learning peculiar to that particular branch of journalism. These are referred to below in the sequence-specific assessment descriptions.
II. Assessment Methods and Processes
Assessment at the Beginning: The Admission Process
Assessment in the School of Journalism begins before students matriculate to Ohio University. From its inception, journalism has been one of the most prominent programs at Ohio University. It grew to more than 1,000 students and enjoyed considerable attention from national press and evaluating associations. Nearly a decade ago, the faculty decided that the School needed more effective control over its enrollment. With the permission of the dean and the provost, a system of selective admissions was instituted in an effort to reduce the school's size and to limit the student group to those most qualified.
Initial admission to the School of Journalism requires that an entering freshman be in the upper 15 percent of his or her high school class and have an ACT score of at least 25 or an SAT score of at least 1140. Applicants who do not make this level as they leave high school may present a professional portfolio to show their interests and abilities, and this portfolio may cause their cases to be reconsidered. Those who enter the university in an undecided or pre-journalism major may apply by the last day of Winter Quarter classes of any year for transfer to the School of Journalism. Such a transfer into the school, either from within or without the university, usually takes a 3.4 or better accumulative average and a showing of professional work. More than 617 applications for the 1998-99 freshman class were evaluated in anticipation of a class of approximately 200. Transfer applications in 1998 numbered 92, from which 40 were chosen for acceptance.
The goal is to seek applicants with the greatest likelihood of success. Annual reports from the university's Office of Institutional Research reflect retention rates, which show an average retention of 91.5 percent over the past six years, a figure that indicates that overall assessment of students is working in a very positive way. The specific yearly breakdown is as follows:
Percentage of Retention from Freshman to Sophomore Years
1992 1993 1994 1995 1996 1997
92% 93% 90% 91% 92% 91%
Another study by the Office of Institutional Research indicates that the School of Journalism has developed an overall plan of assessment that facilitates student success, indicated by a high rate of graduation of 84 percent after six years (as compared to the university rate of 72 percent).
Continuous Assessment Through Advising
Advising is one of the key tools in the School of Journalism's student assessment program. Every quarter students meet with their academic advisers, all of whom are full-time faculty members in the school. The adviser reviews the student's DARS report and evaluates his or her progress toward meeting degree requirements. In addition, the adviser assesses progress toward professional goals, offering students the opportunity to learn about:
Journalism Seniors’ Assessment of Advising, Faculty Interaction, Quality of Program
Based on various surveys of journalism majors, we know that students consider advising an important and beneficial part of their education. For example, a survey was done at the end of Spring Quarter 1998 specifically for inclusion in this report. Distributed in advanced core and sequence classes, the survey was completed by 86 seniors intending to graduate in June or August, and it revealed the following:
Question: Agree Disagree
My adviser knew the degree requirements. 89% 13%
My adviser was able to give me complete answers to questions I asked,
or helped me to find the information I needed. 81% 19%
When asked, my adviser went over my course selections. 81% 9%
My adviser posted office hours and kept them. 73% 16%
I went to see my adviser at times other than during pre-registration. 72% 15%
My adviser seemed concerned about my academic progress. 77% 15%
An Office of Institutional Research study released in March 1998 ("Change in Student Involvement From the First (Freshman) Year to the Senior Year at Ohio University"), indicated that the longer journalism majors are on campus, the more they take advantage of advising, suggesting that they increasingly value the input of not only their academic advisers, but other advisers as well.
Conversations with: 1st year Senior year % increase
Academic adviser 2.2 5.8 164%
Faculty members 2.4 5.1 113%
Student organization adviser 0.5 1.5 200%
Career adviser (or participating in program concerning career) 1.4 3.2 129%
While only an indirect indicator of student assessment, the views of journalism students about the quality of their program of study at Ohio University suggest that these students increasingly value their academic program of study as they go from freshman to senior years. In its March 1998 report, the Office of Institutional Research found the following about journalism majors:
1st year Senior year % increase
Instruction in my major courses 92% important 97% important 5%
64% satisfied 90% satisfied 26%
Faculty availability outside class 84% important 92% important 8%
57% satisfied 74% satisfied 17%
Academic advising 90% important 94% important 4%
53% satisfied 74% satisfied 21%
Adequate academic/intellectual atmosphere 94% important 96% important 2%
79% satisfied 85% satisfied 6%
Assessment by the Curriculum Committee
In order to inform itself as to student progress through graduation, the Curriculum Committee undertook a study of the final DARS reports of the graduating class of 1997. A preliminary summary of the data shows that 125 persons graduated with BSJ degrees in 1997. The average number of hours they earned was 204.25. Very few earned exactly the required 192, and one person had 296 hours. Most of those with high numbers of hours had completed another degree, two minors, or a certificate program. Preliminary figures show the following percentage breakdowns:
Breakdown of Curriculum Committee Study of Student Progress Through Graduation
Quarters needed to graduate Sequences represented Courses taken during last quarter
11 or fewer 3% Advertising 14% All requirements 33%
12 57% Broadcast News 19% All free electives 5%
13 23% Magazine 27% Mixture of required courses
14 4% News/Editorial 10% and free electives 60%
15 or more 13% Public Relations 30% Could not tell 2%
N for entire table = 125
III. Data Analysis/Diagnosis of Strengths and Weaknesses
Assessment Built Into the Curriculum
As is the case in all university programs, student progress is most frequently assessed through Ohio University's standard grading system. Based on course expectations, faculty members establish standards and then provide frequent feedback to students on the degree to which they have met these standards. One constant component of this system in the School of Journalism—based on the college goal of skills in writing, critical thinking, gathering and analysis of information—is that every class is a writing class. As a result, all student work is assessed in part on writing skill and in part on assignment content.
But the school's effort to measure student progress goes well beyond normal grading. The goal is to strengthen faculty understanding of the performance of individual students so that steps may be taken—through class work and through advising—to help students overcome weaknesses and highlight strengths.
Within the curriculum, the most telling examples are found in the requirement that students must earn a C or better in each of the six classes in the curriculum core. The core is made up of individual skills and knowledge, in accord with the college and school goals, that this faculty believes to be essential to all college-educated persons, particularly those in journalism. The courses are designed to help both students and their advisers gain a fundamental grasp of the students' basic abilities to meet these expected outcomes:
Relation of Core Classes to Expected Outcomes
Course Year Taken Expected Outcome
Precision Language Freshman Writing
Graphics Sophomore Computing, Design
Information Gathering Sophomore Gathering, Analysis of Information
News Writing Sophomore Writing
Communication Law Junior/Senior Breadth of Knowledge
Ethics Junior/Senior Breadth of Knowledge
Advisers carefully monitor student progress through the core and recommend appropriate action when problems are confronted. While most students succeed on the first effort in a given class, it remains a faculty goal that students who have specific types of problems may be counseled at the time that is appropriate to their success in school. This is one of the reasons four of the six classes are taken at the freshman or sophomore level.
Such early core courses as Precision Language and News Writing have daily return of papers so that students are aware of their progress at all times. A final grade of C or better is required in all core courses in order to go on in the program. As a result of carefully monitoring of selectively admitted students, 90 percent are successful at achieving a C or better at the first effort and another 5 percent do so at the second effort.
Assessment Within the School of Journalism’s Core and Five Undergraduate Sequences
The School of Journalism has five sequences: Advertising Management, Broadcast News, Magazine, Public Relations, and News Writing and Editing.
Journalism students are accustomed to frequent and demanding assessment in their sequence courses. This assessment often focuses on creative, non-traditional types of assignments aimed at teaching students both the principles and skills required to become journalists. In the core, for example, students take an information gathering course in which they must produce a 50-item annotated bibliography demonstrating advanced research skills. In the ethics course, a core capstone course, students must create portfolios, each of which must include a "Personal Code of Ethics."
The school places particular emphasis on professional assessment in upper-level, sequence-based capstone courses, as well as the professional assessment made of students during their internships. In general, journalism students are assessed by three types of evaluator: the instructor of record, peers, and external reviewers—usually professional journalists. Examples of these assessment processes are outlined below:
Advertising Management
Problem-solving skills are critical to the success of advertising professionals. Many assessment activities done in advertising instruction emphasize analyzing situations, identifying problems, and then proposing and defending viable solutions. Advertising projects are assessed according to accepted industry standards and practices. Peer critiques and editing are commonly applied in course work as a means of instruction and assessment. In advanced classes, students help one another improve their skills and understanding. Each course includes at least one presentation made by each student. The professor and classmates assess and offer critiques on form, substance, and presentation. Tools include evaluation forms, one-on-one meetings with instructors, group coaching, professional critiques, and in-class discussion of students' work. Tests and quizzes are a secondary means of assessing student progress.
The progress of advertising students frequently is assessed by using professional projects and activities as a means of demonstrating knowledge gained and demonstrated to solve real-life problems. Toward this end, nearly 100 Ad Club members each year spend seven months solving a problem for a national advertiser by preparing a complete advertising plan (including fully executed newspaper, magazine, radio and TV advertisements). The students compete against students from more than ten other universities from Ohio, West Virginia, and Kentucky. The five judges are professionals from across the industry. Assessments are made of the plan itself, and the presentation of the plan. OU won 2nd place in this year's competition.
Broadcast Journalism
ACTV-7 News, a nightly half-hour news program, is a senior-level journalism course required of all broadcast journalism majors. It includes nightly assessment in the form of a half-hour meeting following each newscast. During the meeting, the instructor and teaching assistant give each student feedback on his or her work for that particular program. This assessment is different from traditional grading in that it is immediate, and is done in a group setting, which means that everyone present potentially benefits from the assessment that an individual student receives. In addition, the student producer, who is responsible for the content of the newscast, assesses the work of other students in the class. This is the only class at Ohio University that can be seen by the entire community on a nightly basis, as it is televised live on the local cable system. Members of the community can offer their own assessment of the student journalists they see on the program, either through informal conversations on the street or through e-mail or phone calls to the newsroom.
This capstone course in the broadcast journalism sequence offers a significant assessment process that requires students to be active learners through participation/discussion (which is a significant part of the final grade), and presentations that must be 30 minutes, followed by 20 minutes of questions and answers with classmates. Here, students are assessed on the basis of their taking responsibility for learning. In effect, this is viewed as the course in which students learn to take on this responsibility, so that they can continue learning about the field of broadcast journalism beyond their time at Ohio University.
Through the student chapter of the Radio-Television News Directors Association (RTNDA), and particularly the organization's annual Spring conference, students' work is assessed by professional broadcast journalists who critique resume tapes and writing samples in small-group and one-on-one settings.
Magazine
All exercises in the Magazine Editing and Production course are assessed as to whether they are appropriate for audience, or rather, whether the student has successfully argued for appropriateness, since the only real measure of this would be in the marketplace—an assessment technique beyond the budget of any student. Design and research skills also are assessed, using checksheets, lengthy written comments, face-to-face coaching sessions, and in-class discussion. Tests and quizzes rarely are used for assessment.
A peer review system is utilized whereby each student presents details about audience and editorial qualities of a target magazine to the entire class. Students must then read one another's work to evaluate whether the writer has followed the rules he or she presented in the earlier report. The goal is to force writers and editors to avoid the limitations of personal tastes, using an audience's preferences instead as a standard. In addition, students are assessed on their abilities in the areas of focusing, form, structure, voice, and research skills.
The capstone course in the magazine journalism sequence is Magazine Editing Practice. Students in this laboratory course conceive, write, edit, design, and distribute Southeast Ohio magazine. The purpose of the course is to teach students in a realistic environment how to produce an award-winning magazine (2nd place in SPJ competition this year) and work with a team in a professional manner before they graduate and face similar experiences in the workplace. Thus far, this course has served this purpose well. Publishers who hire our students for paid internships and for entry-level positions comment on how prepared our students are and how impressive their work with Southeast Ohio magazine is.
Specialized Business Magazines is another senior-level course that prepares magazine students for entry-level positions with trade, business, and professional magazines and with subscription newsletters. This class prepares students for paid internships sponsored by the Business Press Educational Foundation. For the past four years, Ohio University has led the nation in the number of students accepted into this prestigious program that usually leads to immediate employment after graduation and the paid internship. Last year Ohio students held eight of the 50 internships offered; and this year another eight Ohio students received such internships.
Other magazine courses also employ peer evaluations; each student edits everyone else's stories, and the authors assign the workshop grade based on how helpful this was. In some cases (Journalism 441/541 and 442/542) this counts for half of a 25% final grade component.
News Writing and Editing
The News Writing and Editing sequence has no "capstone" course, but Reporting of Public Affairs, which is required of everyone in this sequence, is the highest course in which these students will meet. Even though students from other sequences can also be in the class, this is a natural setting in which to discuss quality of work of the most advanced news-oriented students in the school. Peer evaluations as well as criticism by the professor are used. In addition, students usually cover real stories (City Council, county commissioner meetings, school board controversies, etc.) also covered by professionals. The students themselves have unique opportunities to compare their resulting stories with those published in newspapers and broadcast in the community. Any student who wishes to assess his or her own work has that opportunity during this course.
The school encourages news writing and editing students to work on The Post as early as possible in their academic careers and to continue this professional experience for as long as possible, achieving an editorial rank for those who are most capable. The advantage of working for such a newspaper is that the work done by the students is assessed not only by their instructors, but by the community. This experience gives students a real taste of what being a journalist is about. More formally, faculty from the school usually make up part of the Post Publishing Board, and through the board participate in assessment of the work that appears in the student newspaper. In addition, one faculty member or graduate assistant systematically criticizes The Post, and the staff often contacts other faculty members for special seminars or question-and-answer periods. Another benefit Post members receive is peer evaluation. Students learn a great deal from the assessment of their peers.
Students in the Reporting Practice or Editing Practice courses at the Athens Messenger are required to submit a portfolio of published clips produced throughout the quarter. The clips are used to assess the performance. Other students in this sequence may have one or more internships, for which they are encouraged to keep clip files for later assessment. Many of these students do both the practice courses at the Messenger and an internship, while others do more than one internship. These vary in methods of assessment, but all students in any sort of practicum are evaluated, usually through personal interviews or written comments, or both.
Through the student chapter of the Society of Professional Journalists (SPJ), faculty advisers are able to assess the progress of "News-Ed" students as they work toward their goal of becoming professional journalists. SPJ has frequently won outstanding chapter and adviser awards, both regionally and nationally.
Public Relations
The Public Relations sequence includes traditional instruction in and assessment of writing, research, speechmaking, newsletter production, etc. In addition, PR students learn how to moderate a panel discussion, organize press conferences, make formal presentations in an executive setting, and plan events. Immediately following each event, students are required to write a one-page report evaluating the presentation. The purpose of this assignment is to get students who were not directly involved in the project to pay attention to it as a learning experience, to learn how to write about it concisely, and provide feedback to the direct participants—including the speakers—following an in-class discussion session. This puts pressure on students in a way that simulates the real-world environment facing graduates in the PR sequence.
Participation in two student PR organizations also is assessed. The Public Relations Student Society of America (PRSSA) and ImPRessions—the student PR company that takes on public relations accounts in the Athens community—offer students the opportunity to go beyond the course work in the PR sequence, and the work done by the students is assessed by the PRSSA's adviser as well as the clients of the PR firm.
Graduate Student Assessment
The graduate curriculum in journalism focuses on theory and research methods, and thus assesses students on their progress in these areas. Students in most journalism school seminars are assessed on the basis of their research and writing abilities, demonstrated in seminar-length research papers. Students are required to present their research to their classmates and instructor in a conference-like setting. The professor then assesses the shortcomings of the research and writing, and offers suggestions as to how the paper can be improved. Professors in several graduate seminars require students to submit their revised papers to national professional research conferences, exposing students to external assessment standards that are common to this field of academic research. For the last few years, Ohio University has been one of the top schools in the nation in the number of presentations at such conferences, and graduate students make up a significant portion of the presentations by OU representatives. In some cases, these papers are then submitted to refereed journals, which subject them to another phase of external assessment. The result, in some cases, is the actual publication of student research in prestigious journals in the field of journalism and mass communication.
Assessment Through Alumni Tracking
The School of Journalism enjoys loyal alumni, many of whom remain in contact with the school, seek our graduates when they achieve levels at which they have hiring responsibilities, and tend to speak very highly of the quality of their educations.
The Office of Institutional Research's report of March 1998 reported the views of recent journalism alumni, who reflected positively on the quality of the education they had received while at Ohio University. The percentages below show the reactions of journalism alumni were more positive than those of either the rest of the College of Communication or of Ohio University overall.
Extremely Very Somewhat Not at all
well well well well
How well did OU prepare me for my career goals? Jour 34% 44% 21% 1%
Com 23% 44% 30% 3%
OU 16% 48% 32% 4%
Satisfaction with major courses Jour 34% 41% 19% 5%
Com 23% 45% 28% 5%
OU 14% 44% 33% 9%
How did OU prepare me for Jour 25% 59% 15% 5%
additional academic work? Com 19% 62% 15% 5%
OU 24% 55% 20% 1%
IV. Evidence of Unit Goals' Being Accomplished
Exit interviewing of 19 graduating seniors was conducted according to instructions received from Douglas Eden, director of the Undergraduate Assessment program at the University of Southern Illinois at Edwardsville. He recommended such interviews when he spoke at our assessment day this year. While the entire instrument he sent was not appropriate to our use, we chose some similar questions to assess graduating students' views of assessment here. This exit survey had just five questions—all geared at student views of assessment.
1 Student judgment of assessment of their work in journalism courses alone:
2 Student judgment of assessment of their work in nonjournalism courses (taken for general education requirements, areas of specialization, etc.) to complete their checksheets:
3 & 4 Encouragement from journalism teachers and advisers to get involved in one of the six student professional groups in the School of Journalism (SPJ, WICI, Ad Club, PRSSA, RTNDA, BSCCC) and/or one of the media outlets in which students can do professional work (The Post, A News, Messenger, ACRN, ACTV7, WOUB, a Green station, Southeast Ohio, a PACE job in which the student writes or edits for a newsletter, etc.)
5 Suggestions of ways other than grades in which students felt evaluated while at Ohio University.
a. really liked the ACTV-7 News critique sessions; learned a great deal therefrom.
b. advice and encouragement outside class given by professors.
c. being recognized by faculty, known as a person, spoken to on street, having internship
or other work outside class recognized and commented upon, etc.
d. being called at home with class advice, internship information, job tip, etc.
e. having feedback tailored to his/her needs.
f. having professors who went out of their ways to help students.
g. having assignments that were marked up, rather than just given letter grade, so students must think.
h. having hard but fair teachers who are determined you will learn something.
i. being encouraged to go to graduate school.
j. being able to talk with professors after class.
k. one-on-one critiques of writing were very valuable.
Assessment by Visiting Professionals and Interviewers
The School of Journalism is fortunate to have had many visiting professionals who have been in residence for various lengths of time over the past nine years to teach classes and interact with students. From the perspective of their successful journalistic careers, they are especially keen evaluators of student progress. They also have been generous in advising the faculty on ways in which students could be better served to meeting professional expectations upon graduation. The visitors have included:
In addition to these professionals, we are visited each year by interviewers for various newspapers, news services, magazines, and so on. Each of these interviewers assesses the portfolios of all students they interview. The number of these interviews increases each year. Many more journalism students received such assessment in off-campus interviews, as well.
Assessment by Professional Advisory Board
The School of Journalism's Advisory Board is made up of professionals representing the school's various constituencies. This group meets twice a year to learn about the school, assess programs and results, and make suggestions. Both faculty members and students may discuss school issues with the board during its meetings. The board's function is to advise the school in all realms of its operation, with particular emphasis on curriculum, professional needs and industry trends. Members are:
V. Improvements Based on Assessment
The School of Journalism has made the following improvements based on past assessment activities and feedback from the university's Assessment Committee:
VI. Conclusions and Recommended Changes
Consistent assessment of program quality as it relates to individual students and of student performance provides a dynamic that separates good from mediocre and excellent from good. Such assessment of student performance must be accomplished throughout the student's career and must be defined as guidance to attaining academic and professional success.
The School of Journalism embraces all opportunities to utilize both forms. And its students, faculty, and alumni are proud of the result of that continuing effort. However, even an excellent program can improve, and some of the ways the School of Journalism could do it are: