How Much Control Should People Keep as AI Gets More Capable

Astute Intelligence Insights

Do More of What Matters.
The Big Picture Edition Vol. 2, No. 21 2026-09-11
AI adoption is becoming a governance choice, not just a software choice

The Trend

This week offered three different answers to the same question: how much control should people keep as AI becomes more capable? New York City chose a one-year moratorium on student-facing generative AI in grades 2-K through 8th grade, with limited high-school pilots and AI literacy lessons. New York City announcement At the G20, U.S. officials pushed a lighter-touch approach to AI oversight. Reuters report Anthropic, meanwhile, announced a product that pairs zero-data-retention privacy with advanced-model safeguards. Anthropic announcement

These are not only technology stories. They are governance stories. A tool changes the work, but a rule decides who may use it, with what data, and who is accountable when the output is wrong.

What It Means for Mission-Driven Organizations

The first risk is uneven access. A large district may be able to run pilots, train staff, and review vendors. A small nonprofit may have one person carrying programs, fundraising, and technology. If every organization is told to “figure out AI” alone, the gap will widen. Shared policies, plain-language training, and community input can narrow it. Microsoft’s Elevate for Changemakers shows one vendor response: credentials, training, and a fellowship built around nonprofit needs. Microsoft announcement

The second risk is false confidence. A policy can be too strict to teach useful skills, or too loose to protect people. The practical middle is a small, testable set of rules: start with low-risk work, keep sensitive data out, require human review, record what happened, and invite feedback from people affected by the decision.

Strategic Question of the Week

What is one AI use your organization should pause, one it should pilot, and one it should teach openly?

Weekend Read

Read New York City’s announcement and look at the details, not just the headline. The policy includes a coalition of students, educators, parents, advocates, unions, and experts to assess the year’s impact. Read the announcement

If your team wants hands-on help thinking this through, you can book time with Warren. Book a conversation

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *