Accuracy Is Not Permission
Marcus came to find Maya the morning after the holdout held, which she would decide later was the most Marcus thing he ever did: he waited until the list was good before he told her it was dangerous.
He set the laptop down the careful way he set everything down, and he’d asked Priya to come, which told Maya this wasn’t a number. Numbers he brought alone.
“The list works,” he said. “That’s what I’m here about. A list that doesn’t work is harmless — you ignore it. This one you’ll trust. So before it drives a single appeal, I need you to see what else it learned while we taught it to see straight.”
He turned the screen. One household — the Calloways, a name Maya half-knew off an old reunion program — except it wasn’t one household now. It was two records, two addresses, and beside them the engine’s own tidy recommendation, the same plain-language reasoning Priya had been so proud of in the sort: Joint giving ended last spring. Two single households, both lapsing. Recommend individual re-engagement.
“They gave together for nineteen years,” Marcus said. “Galas, the parents’ fund, a scholarship with both their names on it. Then this spring the joint gifts stop, his mail starts going to an apartment across town, she comes off his record, one of them quits opening anything we send.” He didn’t touch the screen. “The machine read every bit of that correctly. It’s almost certainly right. They’re coming apart. And what it wants to do about it — because it’s a good machine now, because we fed it well — is call each of them, alone, today, and ask.”
Maya looked at the neat sentence, recommend individual re-engagement, and felt the orange postcard come back up, weeks gone and not an inch smaller.
“It would walk into the middle of someone’s divorce,” she said, “smiling.”
“Faster and surer than any person in this building, and it would log it as a win.” Marcus closed the laptop halfway, the gesture he’d made over Gordon Lacey. “I told you this one was coming. When we mapped the shape — where leave me alone was supposed to live — I said that once the fast thing was reading clean data it would start inferring. Who’s splitting up. Who’s sick. That knowing a thing and being allowed to act on it were two different permissions. I said it was a fight for later.” He met her eyes. “It’s later. It arrived the day the list started working.”
“Show me the sick one,” Maya said, because she could tell there was one.
There was. A donor whose event attendance had dropped off a cliff, whose giving had quietly shifted toward the medical center, who’d added an adult daughter as a second contact and left a planned-gift inquiry sitting half-finished. The engine had him near the top of the major-gift sort, hot, act now. Marcus didn’t dress it up. “It might be right about him, too. And there’s a version of this shop that reads a dying man’s pattern and sends an officer to the foot of the bed with a pledge form, and gets the gift, and lands in the paper. There are standards for what we’re allowed to do with what we can find out about people. I’m the only one in the building who’s read them. The machine hasn’t read them at all.”
“Accuracy is not permission,” Priya said, half under her breath — and Maya saw she was writing it down.
“That’s the whole of it,” Marcus said. “The machine can be right about a person and have no business touching them. It can be true and still be a wound, and it will never feel the difference. So we build it the line, or every true thing it learns becomes one more way to hurt somebody efficiently.”
Maya was already past it. “Run Eleanor.”
Priya did, and it was worse than the divorce, because it was so quiet. Eleanor came up clean — one record, the household, the four thousand dollars in March, no maiden name, no misspelling, no balloon waiting with her name on it. The thing they’d spent a season making true. She wasn’t on the lapsed list anymore; she was an active donor. Which meant the year-end appeal, the big one that swept every active donor in the file, would find her in November as surely as weather.
“Her no still rides nowhere the appeal can read,” Maya said. “We didn’t protect her. We made her easier to find.”
“We got very good at finding her.” Priya’s mouth was flat. “And we still can’t hear her. The one thing Reggie’s known since April — don’t solicit this woman, she’s grieving — lives in the exact three places it lived the morning the card went out. His head. The email tool. A note no machine reads. Every day the file got cleaner, the engine got better at setting her name in front of an ask.”
So they built it the only way they’d learned to build anything that held. Not a memo. Not a careful person promising to remember at the right moment. Consent became a thing that rode on the person — Priya’s words, a property of her, like a name — a field that traveled with Eleanor into every list, every query, into the engine itself, that said do not solicit and said it identically to the appeal, the re-engagement, and whatever they’d buy in ten years to replace all of it. It went onto Priya’s definitions page, under her name, in the change log, beside lapsed and spendable, because it was the same kind of thing — a meaning that had to mean one thing to every machine that touched it. And next to it, the line Marcus drew and would not let anyone sand down: the engine does not act on what it infers about a person’s private life. Not the divorce. Not the diagnosis. It is allowed to know and forbidden to move — full stop, in the pipeline, where no good intention could get around it at four in the morning on the first of the month.
It wasn’t the whole of privacy, and Maya said so out loud, because she’d finally learned to. What the machine should even be allowed to compute about a person was thornier than three weeks could settle, and they’d have to come back to it. For now they did the one piece they could stand behind without flinching: every recorded no honored, every inferred wound left alone. The floor of it — but wired in, not hoped for.
Then Priya ran the appeal one more time, through the new layer, the way Ruth had taught them to run a thing every which way and watch the answer hold — except Ruth wasn’t there, and no one had thought to wish she were. Eleanor came back the way she should have come back in April: off the ask, and flagged instead for a thank-you, and for Reggie, whose unfinished conversation with her about Walter’s fund was a human being’s to carry and not a campaign’s. The Calloways fell off the solicitation queue without a sound. The man at the medical center moved onto a list that did nothing but wait.
“First of every month,” Priya said. “The appeals run, but the suppression runs first, and I check it myself. The thing that found Eleanor is the thing that has to clear her now.” She didn’t say it like a trophy. She said it like a standing chore she was claiming on purpose, which Maya was learning was the only kind of fix that ever lasted.
Maya pulled Eleanor’s record up one last time before they broke, and there it was — in a field on the face of the file, where the card could have read it weeks ago if anyone had built it a place to look: Do not solicit. Steward only. The thing Reggie had carried in his chest since April, the thing that had cost them a widow’s trust and nearly cost them Walter’s gift, sitting in the open at last, in plain words, where the machine would see it every single time and leave her be. The brake hadn’t made the engine weaker. It had made it, for the first time, a thing you could point at people. They hadn’t taught the machine a conscience — it would never have one. They’d handed it theirs and made it ride in the data, which was the only place a conscience had ever managed to hold.