This is fun. Google Gemini’s “Summarize email” function is vulnerable to invisible prompt injection utilized to deceive users, including with fake security alerts.
Post
I continue to maintain that Apple’s slower march to AI puts them in a better place than the rest of the platforms rushing to create new user exposure for bad actors to exploit.
SANITIZE YOUR INPUTS.
Everyone rushing to LLM-ify everything forgot every lesson about input sanitization.
smdh.
@neurovagrant And of course, "sanitize your inputs" is going to fall on deaf ears among the public at large. Hell, you can't even get most people to wash their hands after using the restroom, it seems.
Seriously though, if the system depends on users taking specific actions to ensure their safety, the system is flawed in my opinion. Basically, "whenever you blame the users as a group, you're on the wrong side of the issue" has long been my philosophy.
@lauren @neurovagrant if your system depends on somebody DTRT, you are going to have a bad time
@darkuncle @neurovagrant Don't let the quest for perfect get in the way of the good, as the saying goes.
@lauren @neurovagrant
Interfaces should be designed to be easy to use safely and difficult to use un-safely.
Aw jesus christ, sales types are gonna start using this now too aren’t they
