Design Assessments
Assessing Students Virtually
You already use some combination of tests, quizzes, problem sets, research projects, essays, and other assignments to assess how well your students have learned what you expect them to learn. Now you need to adapt these "assessments of student learning" for an online environment.
Find suggestions for addressing common assessment challenges tailored to your classes or subject area in the rest of this module. In general:
- Break big, high-stakes assessments into smaller, more frequent assessments
- Use Canvas to assignment instructions, collect and grade student work
- Keep your own workload in mind. Find out how in CTL Protip 5.
- If you come devise a great solution, or have a question, join the Discussions.
ITS has lots of useful resources for creating tests and other assessments of student learning:
- This chart offers some suggestions to adapt activities you have used in the past to new, online and virtual environments.
- Identify the skills and knowledge that students are expected to learn and demonstrate
during clinical practice (these are often identified by external accreditation agencies)
- If students can work directly with “clients” either face-to-face or virtually
- Do students have resources and permission to videotape themselves working with clients?
- If they can videotape, you can provide synchronous and asynchronous feedback. Tools such as Sibme can be used to provide feedback on videos.
- Peer evaluation - have students evaluate one another's work
- Do students have resources and permission to videotape themselves working with clients?
- If students cannot work directly with clients (these can also be used for formative
assessments)
- provide videos of other professionals working with clients and have students assess them using the scoring guidelines/evaluation tool that will be used to evaluate them
- have students role play with each other and provide feedback to each other
PDF version: Clinical
For lab courses:
Provide students with a video of the lab and data collected during the experiment
and assign them to develop a laboratory report demonstrating application of theoretical
knowledge to the experimental data. See also tool kit for labs.
For project based learning and capstone courses:
Use ongoing, formative assessment, including weekly planning, review and critique
meetings and written progress reports. Instructors should provide students a regular
meeting time every week to go over the design and development issues and provide adequate
feedback to lead the students to the product design.
Examinations:
Open-ended, open books and notes examinations are recommended. Instructors may email
exam questions with a stipulation to return within a designated time frame. (Extended
time should be provided to students of varying abilities who request accommodations.)
Instructors should communicate their expectations for academic honesty (e.g., no group
work, no contract services) and take appropriate steps to support integrity in the
testing environment including use of Respondus monitoring. Academic integrity communications
and requirements should be applied evenly to all students; it may be a violation of
university policy to single students or groups of students out for additional monitoring.
Examinations:
If using true / false or multiple-choice questions, develop a deep question bank.
Set your Canvas exam settings to prevent backtracking and randomize question order.
Instructors should communicate their expectations for academic honesty (e.g., no group
work, no contract services) and take appropriate steps to support integrity in the
testing environment including use of Respondus monitoring. Academic integrity communications
and requirements should be applied evenly to all students; it may be a violation of
university policy to single students or groups of students out for additional monitoring.
Examinations:
If exam answers contain diagrams , equations, graphs , or schematics, instructors
may assign students to handwrite the answers on paper and submit as a PDF. Instructors
should communicate their expectations for academic honesty (e.g., no group work, no
contract services) and take appropriate steps to support integrity in the testing
environment including use of Respondus monitoring. Academic integrity communications
and requirements should be applied evenly to all students; it may be a violation of
university policy to single students or groups of students out for additional monitoring.
PDF version: Engineering
- Assess often, using a variety of methods. For these “formative” assessments, use short quizzes, quizzes embedded in videos, short responses to analytical questions about the readings, “check-in”s, etc.
- Use Canvas to offer feedback on quiz answers, including referring students to a specific section of the book.
- Consider allowing open book quizzes that students can take as many times as they want.
- For summative assessments, design assignments that discourage cheating. One colleague in political science writes, “I have students choose a recent news article and connect it to class content, which means using something someone previously did for the class wouldn't work, or having students choose a country at the start of class and follow it through the course, writing about it as part of their final exam.”
- Require weekly writing and credit it automatically on submission. Let the students know you will read the weekly writing from the class 3 - 4 times a semester. Use it to help you gauge how well the class is doing with understanding.
PDF version: High DFW
- Identify the purpose(s) of each laboratory session (data analysis, equipment usage,
writing reports, etc.), communicate the purpose(s) to students, and align assessments
with purpose(s) (https://doi.org/10.1021/ed4000102)
- Identify skills that can be accessed remotely, possibly with the use of at-home laboratory
kits or experiments using household materials (see literature on digital badging https://doi.org/10.1021/acs.jchemed.6b00234)
- Consider the use of student-generated video as a way for students to synthesize their
understanding of key topics (https://doi.org/10.1039/C9RP00182D)
- Use pre-recorded videos or student-created videos as an opportunity to have students
analyze and critique poor lab technique and how it may impact experiment outcomes
(https://iopscience.iop.org/article/10.1088/0031-9120/41/6/007/pdf, https://www.lifescied.org/doi/pdf/10.1187/cbe.17-07-0133)
- Utilize peer assessment to allow for a higher volume of student assessment artifacts than may otherwise be feasible given limitation of student/instructor ratio, this can also be used to simulate aspects of the scientific article publication process (https://journals.aps.org/prper/pdf/10.1103/PhysRevPhysEducRes.13.020126, https://doi.org/10.1021/ed8000107).
PDF version: Labs
- Identify the primary learning objective for each exam (e.g., basic knowledge, analytical abilities, critical thinking) and construct the exam in light of that learning objective and the desired level of learning (e.g., Bloom’s Taxonomy)
- Reiterate to students that learning is naturally challenging and some level of struggle is expected. Demonstrate support for this perspective by avoiding having a single make or break exam/assignment. More exams are preferred to fewer. This allows students to accept challenges in learning without condemning them to a grade solely dependent on that one hard moment of learning.
- Create a deep bank of questions and randomly assign each student to see a certain number of questions from the bank
- Know the tools available in Canvas, such as randomization and timers. Explain to
your students how these tools work, and recognize their pros and cons.
- For Spring 2021, CTL recommends against using Respondus Monitor, with a few, rare exceptions. Before you plan to use Respondus Monitor or any other online proctoring application, please explore alternatives and speak with your Dean.
- Faculty who are approved to use online proctoring should plan to consult with ITS and CTL staff on course design and the use of Respondus Monitor or other online proctoring programs, and to develop protocols for screening online proctoring data consistent with best practices.
- Consider pre-emptive honor code and discussion of learning-based environment
- Use formative assessments (e.g., low stakes, open book, high feedback, simplistic grading) AND summative assessments (e.g., traditional exam seeking a normal course distribution)
Additional Resources
Arizona State University, Best Practices for Large-Enrollmment Online Courses
Center for Innovation in Teaching and Learning
Inside Higher Ed, Effective Teaching Online
Learn Worlds, Learner Assessment in Online Courses: Best Practices and MoreUniversity of Maryland, Center for Teaching Excellence
University of Michigan, Center for Research on Learning and Teaching
Vanderbilt University, Center for Teaching
PDF version: Large Lectures with High-Stakes
- Show rather than tell: Case studies and video demonstrations have been found to lead to better assignment outcomes. Demonstrate with real data and actual assignments. https://link.springer.com/article/10.1186/s40594-017-0096-x
- Create your own “how-to” video content: Research shows custom content is more effective than generalized “how-to” videos available online. https://link.springer.com/article/10.1186/s40594-017-0096-x
- When you demonstrate, take things step-by-step: To increase effectiveness of video demonstrations, create a step-by-step “how to” demonstration of procedures, and then discuss the meaning of the outputs https://link.springer.com/article/10.1186/s40594-017-0096-x
- Provide “Hints” or “Tips” notes: In studying quantitative methods, students often have trouble understanding what concepts, tools, and content is the most important; help them do so by providing them this information ahead of the reading, so that they know which concepts to spend the most attention on and not get “lost in the weeds.” https://link.springer.com/article/10.1186/s40594-017-0096-x
- Use Mini-Projects: Mini projects have been found to help students master quantitative course content; hile these can be structured in different ways, having students apply the course concepts immediately after learning them will help to ensure students understand core concepts. These projects can build upon one another and lead to the final project, or stand alone. https://link.springer.com/article/10.1186/s40594-017-0096-x
- Minimize (or eliminate) high stakes exams: Use lower stakes quizzes!
- Host Live Sessions/Office Hours: Students can ask questions about readings as they relate to assignments
PDF version: Quantitative
- Supply, for any performance- or project-based assessment, a brief and rubric/grading
scheme that clearly articulate the artistic goals and student learning outcomes.
- Be cognizant of spatial (performance) and technological (visual) limitations; any
flexibility with submission formats are encouraged. Be mindful that students do not
assume that students have printing capabilities, and may have to reproduce (portions
of) visual assessments by hand; students may also have limited tools that would normally
be available by SDSU or instructor.
- Embrace flexibility of live-testing (for live performances, they can be scheduled
at a mutually convenient time) vs. pre-recorded. Pre-recorded allows students additional
(re-)takes, and provides the instructor additional opportunities to reflect and generate
feedback that normally would have to occur in “real-time.”
- Utilize certain zoom features such: as "hide non-video participants" (https://support.zoom.us/hc/en-us/articles/201362323-How-Do-I-Change-The-Video-Layout-#h_7fbf4fed-9ea2-44ed-83d4-11f1b7b689cd) to look at one or more students performing without seeing the rest of the class's
video tiles, which helps create the sense of watching performers on stage. Mirroring
of screens (https://support.zoom.us/hc/en-us/articles/201379235-iOS-Screen-Sharing-with-the-Zoom-Desktop-Client) is also a valuable tool.
- Provide formative feedback not only synchronous (during virtual meetings) but also asynchronous (either through Canvas) via e-mail, summarizing major points of a meeting, or elaborating on any points. For quizzes/exams over technical components of a course, allow students to retake if they failed, encouraging deeper learning over rote memorization.
PDF version: Studio/Performance and Visual Art Courses
Add Assessments to Canvas
Once you have designed your assessments, add them to Canvas.
- Add assessments and assignments to Canvas within Modules.
- Canvas calls all online tests "Quizzes"
- Check that PDFs and other documents are accessible. Canvas does this automatically - click on the red, orange or green dial-shaped icon next to your documents to see what you need to change.
Assessment Tools Comparison Table