When we chat with an AI or generate an image, it feels almost magical. But behind that sleek, efficient interface sits a massive, invisible pipeline fueled by something pretty unsettling. That's your data, taken without your permission.
A new briefing from Amnesty International, titled Unlawful by Design, pulls back the curtain on how the world's biggest AI systems including GPT-3, Gemini, Llama, and DeepSeek are actually built. The verdict? They are rooted in mass invasions of privacy.
To train these models to think and speak like humans, tech companies use automated tools to scrape billions of public online posts, photos, and social media updates. They call it "data collection," but Amnesty says that these big tech firms are extracting personal info on a grand scale without explicit consent.
The privacy violation is just step one. Because these systems scoop up raw data from the internet, they also absorb all of our worst human habits. The report highlights how scaling up these models actually amplifies hateful content, gender prejudices, and racial biases. What's worse is that these systems are becoming powerful enough to subtly shape users' personal beliefs through predictive suggestions, threatening our basic freedom of thought.
Then there is the physical cost. We tend to think of the "cloud" as weightless, but AI requires massive, energy-guzzling data centers. The infrastructure demands are clearly skyrocketing. Google reported a 48% increase in greenhouse gas emissions since 2019, while Microsoft saw a 29% jump between 2020 and 2024, largely due to AI processing.
These data centers require millions of gallons of water and immense electricity to stay cool. Ironically, they are often built in drought-prone areas like Arizona, Chile, and Mexico, sparking fierce resistance from local, historically marginalized communities who are watching their scarce resources diverted to power algorithms.
Amnesty International is urging governments to step in and ban standalone generative AI systems built on unlawful web scraping. As Likhita Banerji of Amnesty puts it, these design choices aren't inevitable. Tech companies can build a different, fairer future for technology, but only if we hold them accountable for the footprint they are leaving behind today.
