Guidelines for Observation of Online Teaching
Gallaudet University values excellence in teaching. Teaching quality and effectiveness include a collaborative effort by the individual faculty, the program, the department and the University. Accordingly, the evaluative process should be a shared responsibility and should be reflected within the evaluation process.
The University Faculty Handbook discusses faculty engagement with evaluation and observation in different areas of their professional career. Evaluation should stimulate professional growth, academic freedom and yet provide the basis for personnel action. While there is no single best way to deliver instruction, the evaluation and observation of online teaching should reflect best practices. An evidence-based evaluation criterion assists in providing guidelines for best practices and what the faculty member needs to do in order to be considered for reappointment, tenure, promotion and/or merit increase.
Since the University Faculty Handbook specifies that departments develop their own evaluation guidelines for course evaluations, classroom observations, and reflective self-evaluation (p. 17), this guideline includes recommended areas to evaluate when observing online teaching. Departments and programs are welcome to adapt the following guidelines to fit their specific field of study, and utilize certain areas for hybrid and online courses. For online courses, we also include guidelines for evaluating synchronized and asynchronized formats.
The purpose of this guideline is to provide a systematic basis for online observation and evaluation that is as equitable as possible for all disciplines and styles of teaching, and a way to document our observations. The guideline comes in a combination of a checklist, a rating sheet and written analysis. This form can be used to mentor new adjuncts and instructors, assist colleagues in continued improvement and promote teaching excellence.
The resources that supported the development of the following guidelines include but are not limited to Quality Matters rubric and courses, Online Learning Consortium workshops, different University peer evaluation guidelines, and Evaluating Online Teaching: Implementing Best Practices by Tobin, Mandernach and Taylor (2015).
Best Practices for Online Teaching Observation
Bilingualism
Gallaudet University is committed to providing bilingual education in ASL and English in all courses, both onsite and online, integrating the four principles of bilingual education at Gallaudet:
1) direct, visually accessible communication,
2) inclusion and guidance of academically qualified students with diverse language and educational background and abilities,
3) intentional and integrated use of academic discourse in both ASL and English, and
4) enhancing students’ social and cultural experiences.
Our university mission, vision and bilingual education principles were taken into account when developing the following evaluation guidelines.
Framework
In 1987, Seven Principles for Good Practice in Undergraduate Education was published by Chickering and Gamson. They summarized 50 years of higher education research that addressed good teaching and learning practices. Their findings have been widely used to guide and improve college teaching. Their principles provide a useful framework to evaluate the effectiveness of teaching and learning in onsite and online settings.
The Seven Principles
Good practice:
Those principles are integrated into the guidelines below.
Objective and Subjective Approaches
In developing the following guidelines based on best practices in teaching observation, there are two approaches one can take towards observation, that are not necessarily mutually exclusive: an objective and a subjective approach.
1) Objective observation provide a more measurable format, often using a rating scale involving numbers. These types of observations tend to be a part of overall faculty evaluation process.
Some objective observations include statistics downloaded from the course learning management system (LMS, currently Blackboard) and other course elements that may be outside of the LMS (e.g. amount of time spent in Blackboard, length of time in responding to student discussion posts or grading assignments). This is not recommended, for multiple reasons beyond the scope of this guideline. See Tobin, Mandernach and Taylor (2015) for an in-depth explanation as to why.
2) Subjective observation can be useful in exhibiting quality of online teaching that may not be able to be meaningfully measured by an objective observation. This often includes a narrative-based question, response and/or summary.
Integrating a hybrid of both styles are highly recommended.
Summative and Formative Approaches
Formative approaches towards online observations can be especially helpful to faculty. Thus, a faculty member may request multiple observations throughout the semester. Observers can login multiple times throughout the semester, instead of logging in once. A formative approach also gives the faculty member opportunities to improve their online course and their teaching before their next peer evaluation. The observations are coordinated and agreed on by the instructor and peer observers.
Not only that, faculty observers are recommended to meet with the faculty being evaluated, in order to better understand the faculty’s decisions in implementing a certain approach, assignment or group activity prior to completing the peer evaluation, which adds a sense of a formative nature towards evaluation. Evaluators are responsible for providing specific feedback and suggestions. The focus of the discussion should be the theories, best practices and ideas about what constitutes excellence in teaching.
Eskey and Roehrich (2013) research reports that distance learning peer observations should focus on quality education that meets student educational and access needs, serve as a mentoring process for adjunct and face-to-face instructors, and in conjunction with current university policies. Mentoring is an important to improve instruction, technology and collaboration. It is suggested that an online program should be “built based on the face-to-face evaluation model, [university] online policies, online best practices, a team of evaluators, a team of faculty mentors, instructional designers, course developers, a distance learning advisory committee (DLAC), departmental buy-in, and support from the University administration” (Eskey & Roehrich (2013, pp. ).
Online peer observations researchers, Eskey and Roehrich, suggest four categories of course facilitation and evaluation:
These considerations would be crucial in considering cultural and language diversity that would be encountered at Gallaudet University’s Online Program.
Delivery Systems for Courses
Gallaudet courses may be taken in a number of different formats. While most of our classes are offered as face-to-face classes on campus, an increasing number of courses are involving some degree of technological transmission. Many of our teachers combine face-to-face teaching with online materials. In addition, we offer a variety of online courses, both for college credit and for professional studies (PST) credit. Through our extension programs, we can also bring credit courses or contract classes to requested sites given an adequate group of participants. Gallaudet University also has up-to-date facilities to provide video conferencing on the main campus and at the Gallaudet University Regional Centers in various parts of the United States.
The following categories and descriptions of course delivery formats available at Gallaudet University are:
Face-to-Face Courses:
Classroom Course: Course activity is organized around scheduled face-to-face (in-person) class meetings. Classroom courses require students to be present on campus.
Distance Education/Distance Learning Courses include:
Online Courses: Online courses can be asynchronous or synchronous.
Online Asynchronous: Students are NOT required to login at a specific time. Online Asynchronous courses achieve the required credit hours primarily through time spent online at the time of the student's choosing.
Online Synchronous: Students are required to login at a specific time. A synchronous course will indicate this information either within the course description or list a specific online meeting time. Time online could vary between 1% to 100% of course time and activities.
Hybrid Courses: Courses that include a face-to-face component and an online component. A course is designated hybrid if time online is substituted for 51% or more of required in-class time. Hybrid courses can be asynchronous or synchronous. Students are required to attend class meetings or exams on campus, as well as, to participate in an online element.
Hybrid Asynchronous: The online component of hybrid asynchronous courses achieve the required credit hours primarily through time spent online at the time of the student's choosing. Students are NOT required to login at a specific time.
Hybrid Synchronous: The online component of a hybrid synchronous course requires students to login at a specific time. A synchronous course will indicate this information either within the course description or list a specific online meeting time. Time online could vary between 1% to 100% of course time and activities.
Observer Criteria
According to the University Faculty Handbook, observation should be completed by a regular faculty (tenured, tenure-track, non-tenure-track, and pre-tenure-track) who are members of a Department/Program of Instruction.
Online: Faculty members completing the online teaching observation form need to complete Gallaudet’s required online teaching training and have previous experience teaching online courses.
Observer Procedure
This is the recommended observation procedure for teaching online observation. The process can be cyclical, for instance, an observer can go through the below process several times before submitting a final observation. The instructor and peer evaluator should agree upon the observation procedure.
Pre-observation
It is essential that the observer and the faculty being observed are absolutely clear on what areas are being observed and the criteria/point system for each prior to the observation. The faculty being evaluated will need to supply the observer with access to the course syllabus and materials covered during the observation period. Both the observer and the faculty being observed will need to discuss the goals of the observation, which categories will be covered in the observation (see below) and some background about the course (e.g. content already learned, student background and dynamics, and content that will be covered during the observation).
Observation
Online Asynchronous (OA): Exploring the online course may be better near the end of the course, as the evaluator will be able to observe documented student participation and teacher responses across a period of time.
Online Synchronous (OS): Consider having the live video discussion recorded and observed at a later time in order to allow the best bandwidth possible for the faculty and students. Be sure to safeguard the recording in a secure place (e.g. Google Drive where a login is required), allow only certain employees to see the video, for instance, the faculty evaluator and the faculty member being evaluated. Delete immediately after use in order to adhere to FERPA regulations.
Post-observation
A post-observation meeting should be arranged between the faculty evaluator and faculty being evaluated shortly after the observation. Discussion regarding the faculty evaluator’s observation and notes is essential to ensure that the faculty being evaluated can clarify questions or concerns prior to the submission of the faculty evaluation.
Scope of Observation
Teaching involves numerous different areas that can be observed. The following categories and questions are meant to serve as a guide for possible areas a peer faculty may be able to observe. Those categories are not intended to be used as a definitive list of required behaviors or products for teaching online observation.
Observation of Online Teaching Form
Faculty Member: _____________________ Evaluator:__________________________
Course(s):_______________________________________________________________
*Indicate whether a course is hybrid or online by adding HY or OL respectively. Onsite courses do not have a designated acronym.
*Be sure to include course section if multiple sections are offered.
Pre-Observation
Meeting Date(s):_________________________ Time Duration(s):_________________
Scope of Observation: _____________________________________________________
Goals:__________________________________________________________________
Observation
Date(s):__________________________________ Time Duration(s):________________
Content Observed:________________________________________________________
Post-Observation
Meeting Date(s):__________________________ Time Duration(s):________________
Rating: 0 - No evidence, 1- Needs extensive mentoring, 2 - Needs improvement, 3- Satisfactory, 4- Done Well and 5 - Truly Exemplary, and N/A - does not apply.
1. Course LMS: Is the course layout user-friendly, clear, and navigable? Is the design consistent throughout? Is the content chunked in manageable portions? |
|
Notes: |
|
2. Faculty & Student Interaction: Does the course delivery and design promote genuine academic interaction between faculty and students? Between students? Do all students have opportunities to contribute? |
|
Notes: |
|
3. Subject Area Mastery: Does the faculty member show evidence of content area expertise? Are they familiar with current trends, research and publications in their field? Are they able to answer questions, guide and support students in mastering the content? |
|
Notes: |
|
4. Instruction: Does the faculty member present clear objectives or plans for the lesson? Was the pacing appropriate? Were various presentation formats used? Were difficult concepts approaches in a variety of ways? |
|
Notes: |
|
5. Active and Personalized Learning: Are students actively signing, writing, typing or utilizing other forms of self-expression? Do students have opportunities to gather, synthesize, analyze information? Are there collaborative learning activities? Are there alternatives or flexibility in format submissions or topic selection for students? |
|
Notes: |
|
6. Assessment: Are the course and assignment grading criteria communicated clearly? Are the rubrics clear and provide meaningful feedback for students? Are large projects split up in smaller assignments? Are there opportunities for students to receive informal feedback? Are feedback and grades posted within a reasonable amount of time? Is the grading center updated frequently and accessible? |
|
Notes: |
|
7. Inclusion: Are student characteristics such as race, gender, class, ability/disability, religion, language, geographic region, sexual orientation taken into consideration in the course syllabus, design and delivery? Are different perspectives and viewpoints included? Does the course material represent a variety of voices? |
|
Notes: |
Total:__________
Additional Notes:_________________________________________________________
________________________________________________________________________
________________________________________________________________________
Recommended Areas for Improvement:________________________________________
________________________________________________________________________
Signature of Observer:__________________________ Date:______________________
Faculty Member Signature*:______________________________ Date:______________
*The faculty member’s signature means that they have read this report fully, and does not necessarily mean that they agree with the observation.
Resources Used in Developing Online Teaching Observation Guidelines
Many components of this guideline were derived, revised and adapted from other resources including the following:
University of Texas Pan-American
References
Chickering, A. W., & Gamson, Z. F. (1987). Seven Principles for Good Practice in Undergraduate Education. Journal of American Association for Higher Education Bulletin, pp. 3-7.
Edkey, M. T. & Roehrich, H. (2013). A faculty observation model for online instructors: Observing faculty members in the online classroom. Online Journal of Distance Learning Administration, 16 (2). Retrieved from: http://www.westga.edu/~distance/ojdla/summer162/eskey_roehrich162.html
Gallaudet University Faculty (May 2015). Gallaudet University Faculty Handbook.
Tobin, T.J., Mandernach, B.J., & Taylor, A.H. (2015). Evaluating Online Teaching: Implementing best practices. Hoboken, New Jersey: Wiley & Sons Publishing.