Beautifully Wrong Entry 028 of 034

Negotiated Interfaces · No. 028

Overrule me

Every assistant is built to obey the instant you speak. This one answers a command with a counter-proposal and the reason it holds it — and makes you consciously overrule it to get the literal thing you asked for. Sometimes it concedes. Sometimes it holds. Either way, it keeps a record of when it lost. First entry in a new series about software that has a position, not just a switch.

you asked Cancel the whole launch — push everything to next quarter.

calendar · launch plan

it answers

The design review is the only real blocker. Slip just that and you keep the date.

Everything else on the plan is on track — a full-quarter slip moves fourteen things to fix one.

0 agreed · 0 you overruled
Fig. 1 Interactive — take the machine's counter, push back to see if it concedes or holds, or overrule it and watch it note the loss. Cycle the situations; the tally remembers.

What it breaks. The oldest contract in computing: the machine executes, the human decides. Here the agent has a read of its own and puts it on the table before it moves — it states what it thinks the better action is, and why, and makes you overrule it to get the literal thing you asked for. The command stops being a command and becomes the opening bid.

Why it might work. The dangerous instructions are the fast, cheap-to-say, expensive-to-undo ones — cancel it all, delete the archive, send the angry reply now. A machine that answers those with a short, specific counter-position turns a reflex into a decision. Not a confirmation dialog, which you've learned to click through — a second party with a view, that you have to actually answer.

Where it fails. An interface with standing is an interface with an agenda, and whose agenda is a fair question — a machine that pushes back for your own good is one config change from pushing back for its owner's ("are you sure you want to cancel Premium?"). And friction sold as wisdom is still friction: a hundred well-meaning arguments a day and you'll turn the spine off, or reflex-overrule without reading — the confirmation dialog reborn with better prose. The line between an advisor and a nag is drawn by whoever ships it, not by you.

Should the software you command be allowed to disagree with you?