LockDown Browser & Respondus Monitor
In review of key assessment technologies available to NPU faculty for equity and inclusion, we pay particular attention to LockDown Browser and Respondus Monitor. While we encourage instructors to use many of the features these tools offer, we caution against integrating the Facial Detection feature at this time. We don’t recommend using the facial detection feature based on the likelihood of false flags, which will be disproportionately attached to students of color, students with particular accommodation needs, and students who may not have fully stable internet or technological access throughout the exam.
Understanding the Concern with Facial Detection Feature
The Respondus Monitor Facial Detection feature is sensitive to lighting, body movements, and the quality of the video being sent via the webcam device; it is likely to disproportionately misregister students of color, students who engage in movement for concentration, and students who have more basic technologies in terms of webcam and internet access. Due to these factors, we advise instructors to ensure this feature is turned off when utilizing the Respondus Monitor feature. While Respondus Monitor will not prevent a student from completing their exam due to these factors, it will disproportionately incorrectly flag these segments for review by the instructor. Please know that NPU staff has been having open conversations with Respondus Monitor on issues of potential bias, and we feel it’s essential to delve into some of those complexities to help administrators and users better understand them:
Facial recognition is where facial features are converted to a set of unique identifiers or mathematical measurements (distance between eyes, length of nose, angle of the jaw, etc.) and compared to a database of known identities and mapped faces.
Facial detection uses algorithms to determine whether a human face is present. For example, a Nikon camera uses facial detection to detect where faces are located in the frame. It doesn’t convert those faces to a set of unique identifiers or check them against a database.
Respondus Monitor doesn’t save biometric facial data to a database, nor does it compare facial data to an existing database of mapped faces.
There is currently an issue with the use of facial detection technology in proctoring for people with darker skin tones. The problem is mostly associated with lighting and can sometimes result in proctoring warnings that indicate the student cannot be detected in the video frame.
There is robust ongoing conversation around the issue of race and photography/videography (in particular high contrast situations, and what is known as “white balance.”) These are technical factors that greatly affect how clearly a person’s face will appear in a video or photo. A majority of currently available video technologies lack functionality which would enable them to maintain appropriate contrast when the camera tries to compensate for white/bright backgrounds and darker skin tones. This problem is increased when a video is recorded with an inexpensive webcam that uses low-quality video drivers.
Issues with identifying facial features can be further magnified by a slow internet connection which causes the frame rate to be lowered, thus resulting in less data (i.e. frames) being available for analysis.
How to Support Students
Let students know that if they cannot see themselves clearly during the pre-exam webcam check, the system is more likely to flag video segments where it cannot detect their face.
Let students know that flagging doesn’t mean that a student has cheated. Rather, it means that the camera cannot identify the student in the frame for that segment, and it is alerting the instructor to that fact.
The best way for students to improve the quality of their proctoring video is to reduce backlighting situations that cause the face to appear as a silhouette.
Encourage all students to take exams in a well-lit room – ideally, with the light source in front of them, not behind them.
Remind students that Respondus Monitor will alert them if the webcam is having difficulty detecting their face. A correction to the lighting situation will generally rectify this problem and discontinue the warnings during the exam.
Source: Content for this article has been borrowed and modified from University of Denver's Office of Teaching and Learning: http://otl.du.edu/inclusive-use-of-proctoring-technology-lockdown-browser-respondus-monitor/