"To counter that, he revived oral exams and enlisted an AI agent to administer them at scale, in an attempt to "fight fire with fire." "We need assessments that evolve toward formats that reward understanding, decision-making, and real-time reasoning," Ipeirotis said. "Oral exams used to be standard until they could not scale," he added. "Now, AI is making them scalable again." In the blog post detailing the experiment, Ipeirotis said he and his colleague built the AI examiner using ElevenLabs' conversational speech technology."
"The assignments looked brilliant. The understanding didn't. That's when an NYU business school professor decided to fight AI-assisted coursework with AI-powered oral exams. Panos Ipeirotis, a professor at NYU's Stern School of Business who teaches data science, wrote in a blog post published last week that he became concerned about student assignments that read like "a McKinsey memo" but lacked genuine understanding. When he called on students in class and asked them to defend their submissions, many struggled to do so."
A professor at NYU's Stern School of Business revived oral exams and used an AI agent to administer them at scale after noticing student assignments resembled consulting memos but lacked deep understanding. The AI examiner employed ElevenLabs' conversational speech technology and ran two-part oral exams: probing capstone project decisions and selecting in-class cases for live reasoning. Over nine days the system assessed 36 students. The approach aimed to reward understanding, decision-making, and real-time reasoning and to make oral exams scalable again as universities reassess fair assessment methods in the AI era.
Read at Business Insider
Unable to calculate read time
Collection
[
|
...
]