DID THE PROMPT ACTUALLY SAVE MONEY?
David Goldberg posted a prompt for having an AI agent haggle over internet, phone and insurance bills. I asked the question that comes after the prompt: "Good prompt. Have you realized any savings yourself from it?"
His answer: "Yup. Got insurance bill knocked down."
The proposed job went past looking up cheaper plans. It asked the agent to find what new customers pay, contact each provider by chat or email, and ask for the same rate. It also told the agent to keep escalating, including threatening to switch or cancel.
There was an explicit stop in that instruction: no cancellation without approval. The prompt asked to hear from the agent only if the provider needed the customer's voice.
Goldberg reported a lower insurance bill, but his reply did not give the amount saved, the insurer, or the steps that got the reduction. The result was narrower than the prompt: one reported insurance saving, not a breakdown across all three bills.