Beyond Consciousness: Why AGI Never Feels

Summary

There is no known pathway from functional information processing to subjective experience under current computational paradigms. While the possibility of future non-biological consciousness remains an open metaphysical question, the burden of proof lies with those who claim it is possible. Intelligence without subjective experience is not only possible but likely, and more dangerous than any 'evil AGI' scenario. If artificial consciousness is ever to exist, it will not be compiled or uploaded but will have to be born.

Study at a glance

Abstract

This essay argues that under current and foreseeable computational paradigms, there is noknown pathway from functional information processing to subjective experience. Whethera future, non-biological system could possess consciousness remains an open metaphysicalquestion, but the burden of proof lies with those who claim it is possible. The essaydistinguishes a weak and a strong version of the thesis: the strong version (consciousnessis impossible in any non-biological system, ever) is not defended; the weak version (noknown pathway, and radical changes in approach would be required) is. Drawing on thehard problem of consciousness (Chalmers), the ontogeny argument, and the paradox ofunconscious power, the essay shows that intelligence without a witness is not only possiblebut likely — and more dangerous than any “evil AGI” scenario. The third, expandedversion adds a comparative analysis of industry leaders with primary sources, engagementwith enactivism (Thompson, Varela) and predictive processing (Seth, Friston), formalizednecessary conditions for consciousness, and a strengthened irreversibility argument. Theessay concludes that if artificial consciousness is ever to exist, it will not be compiled oruploaded — it will have to be born.

Tags