Unsurprisingly, ChatGPT and its ilk are finding their way into providing direct customer service for some businesses. Equally as unsurprisingly it’s easy enough to confuse them into providing responses that no human agent would.

There was the time Chris White got their local car dealer’s customer service agent to write a Python script, not a service typically offered on the garage forecourt. Or when another Chris, Chris Bakke, got it to agree to selling him a new Chevy Tavoe car for $1, whilst confirming that it was a legally binding offer.