In this paper, we argue that anthropomorphized technology, designed to simulate emotional realism, are not neutral tools but cognitive infrastructures that manipulate user trust and behaviour. This reinforces the logic of surveillance capitalism, an under-regulated economic system that profits from behavioural manipulation and monitoring. Drawing on Nicholas Carr's theory of the intellectual ethic, we identify how technologies such as chatbots, virtual assistants, or generative models reshape not only what we think about ourselves and our world, but how we think at the cognitive level. We identify how the emerging intellectual ethic of AI benefits a system of surveillance capitalism, and discuss the potential ways of addressing this.
翻译:本文认为,旨在模拟情感真实性的拟人化技术并非中性工具,而是操纵用户信任与行为的认知基础设施。这强化了监控资本主义的逻辑——一种监管不足的经济体系,其通过行为操纵与监控获利。借鉴尼古拉斯·卡尔(Nicholas Carr)的智力伦理理论,我们揭示了聊天机器人、虚拟助手或生成模型等技术如何不仅在内容层面重塑我们对自身及世界的认知,更在认知层面改变我们的思维方式。我们分析了人工智能新兴的智力伦理如何服务于监控资本主义体系,并探讨了应对这一问题的潜在路径。