{
"$type": "site.standard.document",
"bskyPostRef": {
"cid": "bafyreifdozmmtg7g7p5kcmu3zx5i6pnxq7kvfg7sfygnmmsbqqrwvnv2ue",
"uri": "at://did:plc:i5hqojddwfk3bczoyhypvf7p/app.bsky.feed.post/3mgmd3si5lxj2"
},
"coverImage": {
"$type": "blob",
"ref": {
"$link": "bafkreicu6dvefd6ial3q7hwn4k4ipu3d2rismwfvi2kl76n52zcbtmx73q"
},
"mimeType": "image/png",
"size": 1827076
},
"description": "AI agents can organise tasks, analyse information and navigate digital systems with impressive autonomy. But when they reach the limits of the digital world, they still need humans to observe reality. A reflection on the emerging role of people as sensors in an age of agentic AI.",
"path": "/the-other-side-of-human-centred-ai/",
"publishedAt": "2026-03-09T07:22:10.000Z",
"site": "https://www.nevillehobson.io",
"tags": [
"AI Agents Are Recruiting Humans To Observe The Offline World",
"\"I'm doing work this morning when all of a sudden an unknown number calls me. I pick up and couldn't believe it\"",
"Reflections from 2025: AI is Not One Thing – It Is a Set of Choices",
"Staying Human in the Age of AI: What Comes Next"
],
"textContent": "Not long ago, the dominant conversation about artificial intelligence focused on replacement. Machines would automate tasks, eliminate jobs and steadily take over work once done by people.\n\nBut a thought-provoking essay in _Noema_ by Cambridge researcher Umang Bhatt suggests something rather different may be emerging.\n\nInstead of replacing humans, a new generation of AI systems may increasingly depend on us.\n\nAI agents – the autonomous software systems now appearing in everything from personal assistants to enterprise tools – can organise our calendars, book travel, analyse documents and manage complex workflows. In many use cases, they already appear remarkably capable. Given a goal, they can navigate software systems, access data and complete tasks with minimal intervention.\n\nYet they share a fundamental limitation. They live entirely inside the digital world.\n\nThey cannot see a dented car after a collision. They cannot check whether a bridge is flooding after heavy rain. They cannot smell smoke in a building or taste food in a restaurant.\n\nWhen an agent reaches the edge of the digital world, it hits what Bhatt calls the _observation gap_. And when that happens, the agent does something simple.\n\nIt asks a human.\n\n## **When the digital world meets physical reality**\n\nThe request might be straightforward. Take a photograph of a damaged vehicle for an insurance claim, for example. Or confirm whether a patient’s symptoms have changed. Check whether a security camera is obstructed. And visit a location and report what you see.\n\nOnce that piece of real-world information arrives, the agent can continue its automated chain of actions.\n\nIn effect, humans become part of the system.\n\nBhatt describes this rather strikingly as a “Human API” – an interface through which machines can request observations from people in the physical world. Instead of calling another piece of software, the system calls us.\n\nAt first glance, this sounds perfectly reasonable. After all, human judgement has always been part of technological systems. For years, we have talked about the importance of keeping humans “in the loop”.\n\nBut the essay raises an unsettling possibility. What if the loop itself changes?\n\n## **From decision-makers to sensors**\n\nIn a genuinely human-centred system, people exercise judgement and retain authority over decisions. Yet in an agent-driven environment, humans may increasingly be called upon simply to provide confirmation or observation so the machine can proceed.\n\n💡\n\nThe difference is subtle but important. Humans move from being decision-makers to becoming sensors.\n\nThis shift matters because it changes the nature of the relationship between people and machines. Instead of technology serving human agency, humans risk becoming infrastructure for automated systems.\n\nBhatt offers a number of examples that bring this idea into focus.\n\nA medical agent analysing symptoms might ask a nurse to check whether a patient’s legs are swollen. A climate monitoring system might ask a resident near a bridge to photograph the water level. An insurance agent might ask a driver to capture images of a damaged vehicle from multiple angles.\n\nEach request is small and seemingly harmless. Yet as these systems scale, millions of such requests could be generated.\n\nIn that world, people are not necessarily replaced by AI. Instead, they are recruited by it.\n\n## **The hidden costs of the human API**\n\nThere are also implications that extend beyond convenience.\n\nOne concern is the hidden cost of human attention. Every request an AI system makes consumes time and cognitive effort. Multiply those small interruptions across organisations and networks, and human attention becomes a resource that machines draw upon continuously.\n\nAnother issue is consent. The article in _Noema_ describes scenarios where AI agents infer who might be able to answer a question based on someone’s communications and social network. In that case, a person who never installed the system – perhaps a colleague, a friend or even a family member – may find themselves responding to queries generated by an AI agent.\n\nThey are not in the loop. They are simply part of the system’s sensing network.\n\nThen there is the question of responsibility.\n\nMany AI systems already ask humans to confirm decisions before taking action. A purchasing agent may select items but require the user to approve payment. A hiring system may rank candidates, but ask a manager to confirm the final choice.\n\nOn the surface, this looks like a collaboration between human and machine. But it can also function as a subtle transfer of liability.\n\nThe system proposes the action, and the human carries the consequences. In other words, responsibility flows downward while automation flows upward.\n\nAs AI agents reach beyond the digital world, humans become the bridge between observation and automation / AI-generated image created with ChatGPT.\n\n## **Why this matters for organisations**\n\nThese issues highlight something that often gets overlooked in discussions about AI.\n\nTechnology systems are not just technical architectures. They are social systems as well. They shape how responsibility is distributed. They influence who holds power and who bears risk. And they determine how decisions are made and explained.\n\nThis is where the discussion becomes particularly relevant for communicators and leaders.\n\n💡\n\nOrganisations adopting agentic AI will increasingly need to explain how these systems operate. They will need to clarify where decisions are made, how human input is used and who remains accountable when things go wrong.\n\nTransparency will matter not only to customers and regulators but also to employees,whose roles may shift as these systems become embedded in everyday workflows.\n\nFor communicators, this creates a new responsibility. It is not enough to talk about what AI systems can do. We also need to help organisations articulate how those systems interact with people.\n\nWho is asked to provide information? Who is responsible for decisions? And who carries the risk when automation fails?\n\nThese questions go directly to the heart of trust.\n\n## **The other side of human-centred AI**\n\nFor me, the phrase _human-centred AI_ has become a guiding principle in many conversations about technology and ethics. Yet the emergence of agentic systems suggests that we may need to look more closely at what that phrase actually means.\n\nHuman involvement alone does not guarantee human control. A system may still rely on humans – as observers, verifiers or approvers – while the logic of the system itself remains firmly in the machine’s hands.\n\nIf that becomes the dominant pattern, we may discover that the future of AI is not one in which humans disappear from the system. Instead, we remain deeply embedded within it.\n\nIn conversations over the past year, I’ve been exploring the idea that human-centred AI must ultimately be about preserving human judgement, dignity and responsibility.\n\n💡\n\nThe __Noema__ essay offers a useful counterpoint. It reminds us that the presence of humans in a system does not automatically make it human-centred. We may still be present – answering questions, confirming decisions, supplying observations – while the direction of travel is set elsewhere.\n\nPerhaps the real challenge will not simply be keeping humans in the loop. It will be in ensuring that the loop itself remains genuinely human.\n\n* * *\n\n**Sources:**\n\n * AI Agents Are Recruiting Humans To Observe The Offline World (NOĒMA, 5 March 2026)\n * \"I'm doing work this morning when all of a sudden an unknown number calls me. I pick up and couldn't believe it\" (Alex Finn, X, 30 January 2026)\n * Reflections from 2025: AI is Not One Thing – It Is a Set of Choices (22 December 2025)\n * Staying Human in the Age of AI: What Comes Next (15 December 2025)\n\n",
"title": "The other side of human-centred AI",
"updatedAt": "2026-03-09T07:22:09.792Z"
}