Artificial intelligence (AI) might not have been created to enable new forms of sexual violence such as deepfake pornography. But that has been an unfortunate byproduct of the rapidly advancing technology.
This is just one example of AI's many unintended uses.
AI's intended uses are not without their own problems, including serious copyright concerns. But beyond this, there is much experimentation happening with the rapidly advancing technology. Models and code are shared, repurposed and remixed in public online spaces.
These collaborative, loosely networked communities - what we call "underspheres" in our recently published paper in New Media & Society - are where users experiment with AI rather than simply consume it. These spaces are where generative AI is pushed into unpredictable and experimental directions. And they show why a new approach to regulating AI and mitigating its risks is urgently needed. Climate policy offers some useful lessons.
A limited approach
As AI advances, so do concerns about risk. Policymakers have responded quickly. For example, the European Union AI Act which came into force in 2024 classifies systems by risk: banning "unacceptable" ones, regulating "high-risk" uses, and requiring transparency for lower-risk tools.
Other governments - including those of the United Kingdom, United States and China - are taking similar directions. However, their regulatory approaches differ in scope, stage of development, and enforcement.
But these efforts share a limitation: they're built around intended use, not the messy, creative and often unintended ways AI is actually being used - especially in fringe spaces.
So, what risks can emerge from creative deviance in AI? And can risk-based frameworks handle technologies that are fluid, remixable and fast-moving?
Experimentation outside of regulation
There are several online spaces where members of the undersphere gather. They include GitHub (a web-based platform for collaborative software development), Hugging Face (a platform that offers ready-to-use machine learning models, datasets, and tools for developers to easily build and launch AI apps) and subreddits (individual communities or forums within the larger Reddit platform).
These environments encourage creative experimentation with generative AI outside regulated frameworks. This experimentation can include instructing models to avoid intended behaviours - or do the opposite. It can also include creating mashups or more powerful variations of generative AI by remixing software code that is made publicly available for anyone to view, use, modify and distribute.
The potential harms of this experimentation are highlighted by the proliferation of deepfake pornography. So too are the limits of the current approach to regulation rapidly advancing technology such as AI.
Deepfake technology wasn't originally developed to create non-consensual pornographic videos and images. But this is ultimately what happened within subreddit communities, beginning in 2017. Deepfake pornography then quickly spread from this undersphere into the mainstream; a recent analysis of more than 95,000 deepfake videos online found 98% of them were deep fake pornography videos.
It was not until 2019 - years after deepfake pornography first emerged - that attempts to regulate it began to emerge globally. But these attempts were too rigid to capture the new ways deepfake technology was being used by then to cause harm. What's more, the regulatory efforts were sporadic and inconsistent between states. This impeded efforts to protect people - and democracies - from the impacts of deepfakes globally.
This is why we need regulation that can march in step with emerging technologies and act quickly when unintended use prevails.
Embracing uncertainty, complexity and change
A way to look at AI governance is through the prism of climate change. Climate change is also the result of many interconnected systems interacting in ways we can't fully control - and its impacts can only be understood with a degree of uncertainty.
Over the past three decades, climate governance frameworks have evolved to confront this challenge: to manage complex, emerging, and often unpredictable risks. And although this framework has yet to demonstrate its ability to meaningfully reduce greenhouse gas emissions, it has succeeded in sustaining global attention over the years on emerging climate risks and their complex impacts.
At the same time it has provided a forum where responsibilities and potential solutions can be publicly debated.
A similar governance framework should also be adopted to manage the spread of AI. This framework should consider the interconnected risks caused by generative AI tools linking with social media platforms. It should also consider cascading risks, as content and code are reused and adapted. And it should consider systemic risks, such as declining public trust or polarised debate.
Importantly, this framework must also involve diverse voices. Like climate change, generative AI won't affect just one part of society - it will ripple through many. And the challenge is how to adapt with it.
Applied to AI, climate change governance approaches could help promote preemptive action in the wake of unforeseen use (such as in the case of deepfake porn) before the issue becomes widespread.
Avoiding the pitfalls of climate governance
While climate governance offers a useful model for adaptive, flexible regulation, it also brings important warnings that must be avoided.
Climate politics has been mired by loopholes, competing interests and sluggish policymaking. From Australia's shortcomings in implementing its renewable strategy, to policy reversals in Scotland and political gridlock in the United States, climate policy implementation has often been the proverbial wrench in the gears of environmental law.
But, when it comes to AI governance, this all-too-familiar climate stalemate brings with it important lessons for the realm of AI governance.
First, we need to find ways to align public oversight with self-regulation and transparency on the part of AI developers and suppliers.
Second, we need to think about generative AI risks at a global scale. International cooperation and coordination are essential.
Finally, we need to accept that AI development and experimentation will persist, and craft regulations that respond to this in order to keep our societies safe.
(Author: Milica Stilinovic, PhD Candidate, School of Media and Communications; Managing Editor, Policy & Internet journal, University of Sydney; Francesco Bailo, Lecturer in Data Analytics in the Social Sciences, University of Sydney, and Jonathon Hutchinson, Chair of Discipline, Media and Communications, University of Sydney)
(Disclaimer Statement: Francesco Bailo has received funding from Meta and from Australia's Department of Defence.
Jonathon Hutchinson and Milica Stilinovic do not work for, consult, own shares in or receive funding from any company or organisation that would benefit from this article, and have disclosed no relevant affiliations beyond their academic appointment.)
This article is republished from The Conversation under a Creative Commons license. Read the original article.
(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)
