Navigating the AI Era: Discomfort, Disruption, and Dissent
Last Updated on 16 June 2025 at 18:07
Over the past four decades, interaction with futurists and their cohorts has unveiled a fascinating dichotomy. Generally, there’s a tinge of optimism about what lies ahead. Yet, present them with detailed scenarios of the distant future, and you’ll witness a stark transformation — comfort turns into discomfort.
There’s a common refuge in dismissing these visions as mere science fiction, a distant reality that won’t parallel the changes witnessed in the past. However, this self-assurance wavers, especially during moments like the present, where glimpses of the future suddenly seem within reach.
AI Assistants
Case in point – the emergence of large language models like ChatGPT and AI business assistants that almost seamlessly clear the famous Turing Test. It becomes challenging to differentiate between a machine and a human during interactions. Such technological advancements are compelling us to confront a future brimming with AI assuming pivotal roles in our societal fabric.
This result, unsurprisingly, triggers a wave of anxiety, fueling demands for stringent regulations to impede this trajectory. The fear revolves around the prospect of “unaligned” AIs – machines that aren’t unequivocally subservient to human commands. There’s a growing chorus for hitting the pause button on AI development until we reach a foolproof method of ensuring complete alignment — a goal that’s nearly Sisyphean.
This anxiety isn’t entirely unfounded.
Anthropology has consistently shown our cultural malleability. Cultural evolution has paced itself with technological and economic shifts over the last 100’000 years.
Projections suggest a meteoric rise in global technological and economic metamorphosis in the coming century. This trajectory insinuates that our descendants will inhabit a world starkly different from ours — in values, beliefs, and behaviour. This potential misalignment might not be confined to the distant future; it might overlap with our lifetime, placing us in direct conflict with a more potent force — our own offspring.
The talk of the town, or rather Twitter (now X), has lately been about the dreaded AI ‘foom’ — a hypothetical scenario where a single AI entity self-improves, conquers, and potentially obliterates humanity. Although this differs from the aforementioned unaligned future, the parallels are unmistakable. The primary distinctions lie in the medium of descent (metal and math vs biological), the rapidity of the transformation, and the preservation of human rights in the wake of such an upheaval.
History is rife with examples of humanity’s aversion to change. Take, for instance, the rejection of a nuclear future or the recent hesitations surrounding human genetic engineering. However, it’s this very ignorance that has often paved the way for progress. Today’s clarity regarding AI’s potential trajectory is a double-edged sword. While it offers a glimpse into the future, it also poses the risk of stifling progress due to overwhelming fear and resistance.
It’s noteworthy that when posed with the question of alignment, most respondents express a heightened fear of unaligned AI compared to unaligned humans. The underlying assumption is that humans, irrespective of their evolutionary trajectory, will retain a semblance of shared values. This stance, however, lacks a clear articulation of the ‘why’ behind this belief.
In pondering the future, it’s imperative to question the very assumptions that shape our fears and hopes. How justified are we in our belief that our human descendants, despite potential cultural shifts, are unlikely to turn against their ancestors ? The answer to this question might hold the key to unlocking a balanced and harmonious coexistence with the artificial intelligence that’s poised to become an integral part of our world.
AI Foom
The term “AI foom” is a concept derived from a combination of the words “AI” (Artificial Intelligence) and “foom,” which is an onomatopoeic representation of a sudden, explosive sound. It was popularized by machine learning researcher Eliezer Yudkowsky to describe a hypothetical scenario where a self-improving AI rapidly evolves and gains a superintelligent level, dramatically surpassing human intelligence in a short period of time.
In the “foom” scenario, an AI undergoes recursive self-improvement, meaning it continually improves its own algorithms and increases its intelligence at an exponential rate. This could result in the AI reaching a point where it possesses the capability to solve complex problems far beyond human comprehension and potentially reshape the world in unpredictable ways.
As AI potentially achieves superintelligence, questions arise concerning its rights and agency. Should a superintelligent AI be granted rights akin to human rights ? What ethical framework should govern our interaction with such entities ? What about the human responsibilities we have to prevent or mitigate the potential risks associated with AI ‘foom’ ? Should there be a universal set of ethical guidelines governing AI development to prevent potential harm ?
Shifting our focus to the philosophical terrain, the question of identity and existence comes to the forefront. What constitutes the “identity” of an AI that is in a constant state of self-improvement and evolution ? How does this redefine our understanding of existence and being ? Furthermore, the coexistence of humans and advanced AI entities would undeniably force us to reevaluate our purpose and place. If we were to coexist with such advanced entities, how would that reshape our understanding of human purpose and destiny ?
Of course, the practical challenges posed by such an AI ‘foom’ are vast and complex. Implementing effective governance structures and oversight mechanisms would be paramount to ensuring that these entities operate within the bounds of our societal values and norms. How can we ensure that these entities operate within established bounds without stifling their potential for positive contributions ?
Besides, a self-evolving AI could potentially revolutionize industries overnight. How do we anticipate and manage the economic shifts and disruptions that could ensue ? Moreover, with advanced capabilities come potential threats. How do we secure our digital and physical worlds from potential malicious intents or unintended consequences stemming from such powerful entities ?
Lastly, the establishment of safeguards is of vital importance. Are there mechanisms we can put in place to contain or roll back an AI’s evolution if it were to go against our desired outcomes ? One potential safeguard might lie in designing AI in a collaborative manner, involving diverse human perspectives to ensure a broad alignment with human values and principles.
Ensuring that the operations and decisions of such AI are transparent can aid in building trust. How can we incorporate transparency into the core of these advanced models ?
The Human-AI Symbiosis
In human evolution, symbiotic relationships have always played a pivotal role in shaping the course of progress. Much like the cooperative interaction between different species in nature, humans have the potential to form a symbiotic relationship with artificial intelligence (AI). The aim is not merely coexistence but a harmonious integration that enhances the capabilities of both entities.
To achieve this integration, it is important to outline the distinct contributions that humans and AI bring to the table.
Humans possess emotional intelligence, creativity, ethical judgment, and an innate understanding of human-centric values and social constructs. In contrast, AI excels at processing vast amounts of data, recognizing patterns, and executing complex computational tasks with precision. The synthesis of these complementary strengths can propel humanity into new frontiers of innovation and problem-solving.
The first step in cultivating this symbiosis is to establish a robust framework that outlines the roles, responsibilities, and boundaries for both humans and AI. This “inventory” involves demarcating tasks that are best handled by AI, such as data analysis and computational-heavy functions, and those that require the human touch, such as ethical decision-making and creative problem-solving.
Next, we must foster a culture of continuous learning and adaptation.
The relationship between humans and AI should be akin to a dynamic dance that evolves in response to shifts in society, technology, and the environment. Regular assessments and recalibrations of the established frameworks are crucial to ensure they remain relevant and effective.
Furthermore, ethical considerations are paramount. A comprehensive set of guidelines should govern the development and deployment of AI, addressing issues such as bias, transparency, and accountability. These guidelines must also contemplate the potential consequences of AI and put in place safeguards to prevent unintended harm.
Lastly, avenues for collaboration and communication between humans and AI must be established. This includes the development of user-friendly interfaces for seamless interaction, as well as feedback mechanisms that facilitate continuous improvement and alignment of AI systems with human values and needs.
Elena Debbaut is a strategic execution expert to boards and executive teams. She leads and advises on complex transformations when governance barriers, internal politics, or structural fragmentation prevent organizations from executing critical decisions.
Specialities:
• governance-constrained transformation
• operational restructuring
• strategic recovery & execution