Generative AI is a data hog.
The algorithms behind chatbots like ChatGPT learn to create human-like content by scraping terabytes of online articles, Reddit posts, TikTok captions, or YouTube comments. They find intricate patterns in the text, then spit out search summaries, articles, images, and other content.
For the models to become more sophisticated, they need to capture new content. But as more people use them to generate text and then post the results online, its inevitable that the algorithms will start to learn from their own output, now littered across the internet. Thats a problem.
A study in Nature this week found a text-based generative AI algorithm, when heavily trained on AI-generated content, produces utter nonsense after just a few cycles of training.
The proliferation of AI-generated content online could be devastating to the models themselves, wrote Dr. Emily Wenger at Duke University, who was not involved in the study.
Although the study focused on text, the results could also impact multimodal AI models. These models also rely on training data scraped online to produce text, images, or videos.
As the usage of generative AI spreads, the problem will only get worse.
The eventual end could be model collapse, where AI increasing fed data generated by AI is overwhelmed by noise and only produces incoherent baloney.
Its no secret generative AI often hallucinates. Given a prompt, it can spout inaccurate facts or dream up categorically untrue answers. Hallucinations could have serious consequences, such as a healthcare AI incorrectly, but authoritatively, identifying a scab as cancer.
Model collapse is a separate phenomenon, where AI trained on its own self-generated data degrades over generations. Its a bit like genetic inbreeding, where offspring have a greater chance of inheriting diseases. While computer scientists have long been aware of the problem, how and why it happens for large AI models has been a mystery.
In the new study, researchers built a custom large language model and trained it on Wikipedia entries. They then fine-tuned the model nine times using datasets generated from its own output and measured the quality of the AIs output with a so-called perplexity score. True to its name, the higher the score, the more bewildering the generated text.
Within just a few cycles, the AI notably deteriorated.
In one example, the team gave it a long prompt about the history of building churchesone that would make most humans eyes glaze over. After the first two iterations, the AI spewed out a relatively coherent response discussing revival architecture, with an occasional @ slipped in. By the fifth generation, however, the text completely shifted away from the original topic to a discussion of language translations.
The output of the ninth and final generation was laughably bizarre:
architecture. In addition to being home to some of the worlds largest populations of black @-@ tailed jackrabbits, white @-@ tailed jackrabbits, blue @-@ tailed jackrabbits, red @-@ tailed jackrabbits, yellow @-.
Interestingly, AI trained on self-generated data often ends up producing repetitive phrases, explained the team. Trying to push the AI away from repetition made the AIs performance even worse. The results held up in multiple tests using different prompts, suggesting its a problem inherent to the training procedure, rather than the language of the prompt.
The AI eventually broke down, in part because it gradually forgot bits of its training data from generation to generation.
This happens to us too. Our brains eventually wipe away memories. But we experience the world and gather new inputs. Forgetting is highly problematic for AI, which can only learn from the internet.
Say an AI sees golden retrievers, French bulldogs, and petit basset griffon Vendensa far more exotic dog breedin its original training data. When asked to make a portrait of a dog, the AI would likely skew towards one that looks like a golden retriever because of an abundance of photos online. And if subsequent models are trained on this AI-generated dataset with an overrepresentation of golden retrievers, they eventually forget the less popular dog breeds.
Although a world overpopulated with golden retrievers doesnt sound too bad, consider how this problem generalizes to the text-generation models, wrote Wenger.
Previous AI-generated text already swerves towards well-known concepts, phrases, and tones, compared to other less common ideas and styles of writing. Newer algorithms trained on this data would exacerbate the bias, potentially leading to model collapse.
The problem is also a challenge for AI fairness across the globe. Because AI trained on self-generated data overlooks the uncommon, it also fails to gauge the complexity and nuances of our world. The thoughts and beliefs of minority populations could be less represented, especially for those speaking underrepresented languages.
Ensuring that LLMs [large language models] can model them is essential to obtaining fair predictionswhich will become more important as generative AI models become more prevalent in everyday life, wrote Wenger.
How to fix this? One way is to use watermarksdigital signatures embedded in AI-generated datato help people detect and potentially remove the data from training datasets. Google, Meta, and OpenAI have all proposed the idea, though it remains to be seen if they can agree on a single protocol. But watermarking is not a panacea: Other companies or people may choose not to watermark AI-generated outputs or, more likely, cant be bothered.
Another potential solution is to tweak how we train AI models. The team found that adding more human-generated data over generations of training produced a more coherent AI.
All this is not to say model collapse is imminent. The study only looked at a text-generating AI trained on its own output. Whether it would also collapse when trained on data generated by other AI models remains to be seen. And with AI increasingly tapping into images, sounds, and videos, its still unclear if the same phenomenon appears in those models too.
But the results suggest theres a first-mover advantage in AI. Companies that scraped the internet earlierbefore it was polluted by AI-generated contenthave the upper hand.
Theres no denying generative AI is changing the world. But the study suggests models cant be sustained or grow over time without original output from human mindseven if its memes or grammatically-challenged comments. Model collapse is about more than a single company or country.
Whats needed now is community-wide coordination to mark AI-created data, and openly share the information, wrote the team. Otherwise, it may become increasingly difficult to train newer versions of LLMs [large language models] without access to data that were crawled from the internet before the mass adoption of the technology or direct access to data generated by humans at scale.
Image Credit: Kadumago / Wikimedia Commons
Read the original here:
This Is What Could Happen if AI Content Is Allowed to Take Over the Internet - Singularity Hub
Related Posts
- Short Interest in Singularity Future Technology Ltd. (NASDAQ:SGLY) Drops By 14.8% - Defense World - July 28th, 2024 [July 28th, 2024]
- This Weeks Awesome Tech Stories From Around the Web (Through July 27) - Singularity Hub - July 28th, 2024 [July 28th, 2024]
- What Is the Singularity? And Should You Be Worried? - Electronics | HowStuffWorks - July 28th, 2024 [July 28th, 2024]
- The Singularity by 2045, Plus 6 Other Ray Kurzweil Predictions - Electronics | HowStuffWorks - July 28th, 2024 [July 28th, 2024]
- AI-Powered Weather and Climate Models Are Set to Change Forecasting - Singularity Hub - July 28th, 2024 [July 28th, 2024]
- Scientists Say They Extended Mices Lifespans 25% With an Antibody Drug - Singularity Hub - July 28th, 2024 [July 28th, 2024]
- Ray Kurzweil Still Says He Will Merge With A.I. - The New York Times - July 6th, 2024 [July 6th, 2024]
- Daybreak acquires Singularity 6 - GamesIndustry.biz - July 6th, 2024 [July 6th, 2024]
- Are We Only 20 Years from the Singularity? - Government Technology - July 6th, 2024 [July 6th, 2024]
- Daybreak bought Palia studio Singularity 6 and aims to bring the game to launch - Massively Overpowered - July 6th, 2024 [July 6th, 2024]
- Palia developer Singularity 6 is now part of the Daybreak Game Company - PC Gamer - July 6th, 2024 [July 6th, 2024]
- Daybreak Acquires Palia Developer Singularity 6 - The Outerhaven - July 6th, 2024 [July 6th, 2024]
- Chinese company achieves breakthrough in race to fusion here's why it's a major step toward unlimited affordable power - The Cool Down - July 6th, 2024 [July 6th, 2024]
- Palia developer Singularity 6 is now part of the Daybreak Game Company - MSN - July 6th, 2024 [July 6th, 2024]
- Ray Kurzweil Predicts the AI Future by 2045 - The Dales Report - July 6th, 2024 [July 6th, 2024]
- Education in the spotlight at Singularity South Africa Summit 2024 - Bizcommunity.com - July 6th, 2024 [July 6th, 2024]
- Daybreak Has Acquired Palia Studio Singularity 6 - PlayStation Universe - July 6th, 2024 [July 6th, 2024]
- Letter: The AI singularity is only nearer for wrong reasons - New Scientist - June 20th, 2024 [June 20th, 2024]
- Modes of Witness: On The Singularity and The Simple Art of Killing a Woman - Public Books - June 20th, 2024 [June 20th, 2024]
- The Singularity Heist: When AIs Crave Crypto | by Anthony Williams | Jun, 2024 - DataDrivenInvestor - June 20th, 2024 [June 20th, 2024]
- What 70 Years of AI on Film Can Tell Us About the Human Relationship With Artificial Intelligence - Singularity Hub - June 20th, 2024 [June 20th, 2024]
- SNL: Anthony Michael Hall on RDJ Bond, Sketches, "Singularity" Update - Bleeding Cool News - June 16th, 2024 [June 16th, 2024]
- What "naked" singularities are revealing about quantum space-time - New Scientist - June 16th, 2024 [June 16th, 2024]
- Review: "The Singularity Play" by Jackalope Theatre Company - Chicago Tribune - June 16th, 2024 [June 16th, 2024]
- This Week's Awesome Tech Stories From Around the Web (Through June 15) - Singularity Hub - June 16th, 2024 [June 16th, 2024]
- The AI Singularity Is Nothing to Fear - hackernoon.com - June 16th, 2024 [June 16th, 2024]
- AI Unearths Nearly a Million Potential Antibiotics to Take Out Superbugs - Singularity Hub - June 16th, 2024 [June 16th, 2024]
- The Singularity Play tackles AI - Chicago Reader - May 31st, 2024 [May 31st, 2024]
- How Bear McCreary Got Slash to Play on The Singularity - Consequence - May 31st, 2024 [May 31st, 2024]
- Black hole singularities defy physics. New research could finally do away with them. - Space.com - May 31st, 2024 [May 31st, 2024]
- This Week's Awesome Tech Stories From Around the Web (Through May 25) - Singularity Hub - May 31st, 2024 [May 31st, 2024]
- This Device Zaps the Spinal Cord to Give Paralyzed People Use of Their Hands Again - Singularity Hub - May 31st, 2024 [May 31st, 2024]
- Converging Towards The Radio Singularity - RadioInsight - RadioInsight - May 3rd, 2024 [May 3rd, 2024]
- This Week's Awesome Tech Stories From Around the Web (Through April 27) - Singularity Hub - May 3rd, 2024 [May 3rd, 2024]
- I never would have dreamed that I would hear this song performed by two of the guitar gods who inspired it: Joe ... - Guitar World - May 3rd, 2024 [May 3rd, 2024]
- Scientists Find a Surprising Way to Transform A and B Blood Types Into Universal Blood - Singularity Hub - May 3rd, 2024 [May 3rd, 2024]
- Singularity Future Technology Ltd (SGLY) is up 43.55% Tuesday In Premarket Trading - InvestorsObserver - March 18th, 2024 [March 18th, 2024]
- This Week's Awesome Tech Stories From Around the Web (Through March 16) - Singularity Hub - March 18th, 2024 [March 18th, 2024]
- Breakpoint: The promises and perils of artificial intelligence - Chattanooga Times Free Press - March 18th, 2024 [March 18th, 2024]
- Palia reaches over 3m players in six months thanks to "invaluable" Switch partnership - GamesIndustry.biz - March 18th, 2024 [March 18th, 2024]
- 2054, Part III: The Singularity - WIRED - February 8th, 2024 [February 8th, 2024]
- This Week's Awesome Tech Stories From Around the Web (Through February 3) - Singularity Hub - February 8th, 2024 [February 8th, 2024]
- Jaspreet Bindra on Generative AI and the Road to Singularity - Analytics India Magazine - February 8th, 2024 [February 8th, 2024]
- EIA Says 40 Percent of US Electricity Is Now Emission-Free for the First Time - Singularity Hub - January 10th, 2024 [January 10th, 2024]
- The Crossroads of Humanity: Embracing the Singularity | by Michiel Meire | Jan, 2024 - Medium - January 10th, 2024 [January 10th, 2024]
- MotoGP, The 'singularity' of the rider market: in 2024 Marquez will play full court - GPOne.com - January 10th, 2024 [January 10th, 2024]
- Debating the Claim of Consciousness by Haley AI and the Ethical Implications of AI - Medriva - January 10th, 2024 [January 10th, 2024]
- [Master Duel] November 9th Update - YGOrganization - November 9th, 2023 [November 9th, 2023]
- Palia Update Adds New Customization Options, Starstones, and More - GameRant - November 9th, 2023 [November 9th, 2023]
- Robby Krieger And The Soul Savages Announce Debut Album - Dig! - November 9th, 2023 [November 9th, 2023]
- 'The white man's burden' Northern Iowan - Northern Iowan - November 9th, 2023 [November 9th, 2023]
- The Singularity Is Less Than 10 Years Away, Says AI Veteran - Decrypt - November 7th, 2023 [November 7th, 2023]
- Georgia lawmakers explore threats, wonders of AI technology with ... - Georgia Recorder - November 7th, 2023 [November 7th, 2023]
- What Is a White Hole, and Do White Holes Really Exist? - Popular Mechanics - November 7th, 2023 [November 7th, 2023]
- International law matters even when the West abandons it - The New Humanitarian - November 7th, 2023 [November 7th, 2023]
- In the search for alien life, should we be looking for artificial ... - Space.com - October 15th, 2023 [October 15th, 2023]
- Ask Ethan: Are singularities physically real? - Big Think - October 15th, 2023 [October 15th, 2023]
- Are We Approaching the Singularity? - Walter Bradley Center for Natural and Artificial Intelligence - October 15th, 2023 [October 15th, 2023]
- Midweek Modular: SkaldOne, Arbhar 2, Sovage and The Singularity - gearnews.com - October 15th, 2023 [October 15th, 2023]
- Many experts think that AI could ultimately lead to disaster - Buffalo News - October 15th, 2023 [October 15th, 2023]
- Big AI Tech Wants To Disrupt Humanity Dataetisk Tnkehandletank - DataEthics.eu - October 15th, 2023 [October 15th, 2023]
- 10 reasons why you need to see a Powell and Pressburger movie - Time Out London - October 15th, 2023 [October 15th, 2023]
- Annual symposium discusses ethics of artificial intelligence - The Connection - October 15th, 2023 [October 15th, 2023]
- Genshin Impact Arkhium Stock and how to use the Forging Press - VG247 - October 15th, 2023 [October 15th, 2023]
- Genshin Impact Mysterious Ore locations - VG247 - October 15th, 2023 [October 15th, 2023]
- Every Borg Ship In Star Trek - Screen Rant - August 22nd, 2023 [August 22nd, 2023]
- Physicists identified a mechanism for the formation of oscillating ... - Tech Explorist - August 22nd, 2023 [August 22nd, 2023]
- Chatting with Jesus: the rise of Twitch AI streams - Eurogamer.net - August 22nd, 2023 [August 22nd, 2023]
- How to get Iron Ore in Palia - Dot Esports - August 22nd, 2023 [August 22nd, 2023]
- How a Forgotten Thriller Tried to Warn Us About the Future - MovieWeb - August 22nd, 2023 [August 22nd, 2023]
- Announcing Threat Detection for Amazon S3 | AI-Powered Data ... - SentinelOne - August 22nd, 2023 [August 22nd, 2023]
- The Armed - Perfect Saviors - Northern Transmissions - August 22nd, 2023 [August 22nd, 2023]
- Hyzon Motors Elects Erik Anderson as Chairman of the Board of ... - citybiz - August 22nd, 2023 [August 22nd, 2023]
- Red Matter in the Star Trek Movie Canon, Explained - CBR - Comic Book Resources - August 22nd, 2023 [August 22nd, 2023]
- Transformers Rise of the Beast: The One Scene That Completely ... - MovieWeb - June 28th, 2023 [June 28th, 2023]
- Is It An MMO? #12 Upcoming "Cozy" Community Sim Palia Might ... - MMOBomb - June 28th, 2023 [June 28th, 2023]
- New theory of gravity rethinks the Big Bang - Advanced Science News - June 28th, 2023 [June 28th, 2023]
- Lucas Uchida Repeats The Megg V14 - Gripped Magazine - June 28th, 2023 [June 28th, 2023]
- Tower of Fantasy Version 3.0 Update Launches June 27 - Final Weapon - June 28th, 2023 [June 28th, 2023]
- Without 1 Shocking Power, Superman Would Be Stranded on Earth - Screen Rant - June 28th, 2023 [June 28th, 2023]
Tags:
