The "David Mayer" block shows how hard-coded filters can create disruptive challenges for users, allowing adversarial attacks and restricting functionality in ChatGPT.
Riley Goodside demonstrated how a visual prompt injection using the name "David Mayer" can halt a ChatGPT session without the user's clear understanding of why this occurs.
By preventing ChatGPT from processing popular names like "David Mayer," the filter complicates interactions for individuals sharing that name, affecting usability in practical scenarios.
These filters raise concerns about user convenience and effectiveness, as they could hinder educators from using ChatGPT for assistance with students sharing common names.
Collection
[
|
...
]