Meta's Llama model has memorized Harry Potter and sensual eroticismthe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence Meta
Getting Started with Gmail Keyboard Shortcuts
Everyone has the most absurd answers for this question about triangles
Prince Harry and Meghan Markle want people to donate to charity rather than sending wedding gifts
A guide to floral foam videos, the slime videos of 2018
GPU Pricing Update, Year in Review: Price Trends Charted
There's a life
'The Great British Baking Show' co
Dancers prove you can dance to anything, even the Mii Channel theme song
AC Milan vs. Feyenoord 2025 livestream: Watch Champions League for free
Spotify has acquired audiobook platform Findaway
Obama photographer Pete Souza on Trump: 'We failed our children'
There's an asteroid following Earth, and it may be from the moon
LA's Staples Center renamed Crypto.com Arena, and some people are angry
Michelle Obama shared the perfect parenting metaphor for Trump's White House
NYT Connections Sports Edition hints and answers for January 28: Tips to solve Connections #127
Where the infrastructure bill's $7.5 billion for EV charging is needed most
MindBody crashed, so studios, teachers, and fitness lovers were pissed
Everything to know about 'The Wheel of Time' before it premieres
Elon Musk told Donald Trump what to do about the Paris Climate Agreement
There's an asteroid following Earth, and it may be from the moon
Atletico Madrid vs. Leverkusen 2025 livestream: Watch Champions League for freeNYT Connections Sports Edition hints and answers for January 21: Tips to solve Connections #120Golden State Warriors vs. Sacramento Kings 2025 livestream: Watch NBA onlineBoston Celtics vs. LA Clippers 2025 livestream: Watch NBA onlineAmtrak deal: Save on travel from Feb. 1 through March 316 Trump Inauguration speech highlights — and how the internet reactedDjokovic vs. Alcaraz 2025 livestream: Watch Australian Open for freePhoenix Suns vs. Cleveland Cavaliers 2025 livestream: Watch NBA onlineNYT Strands hints, answers for January 20NYT Connections Sports Edition hints and answers for January 20: Tips to solve Connections #119Phoenix Suns vs. Brooklyn Nets 2025 livestream: Watch NBA onlineShop the LG C3 Series 65NYT Connections Sports Edition hints and answers for January 21: Tips to solve Connections #120Keys vs. Svitolina 2025 livestream: Watch Australian Open for freeTrump inauguration time, how to watch the livestreamFlexiSpot Flash Sale: Get up to 41% off standing desks and moreNASA built new tires for Mars. They're nothing like your tires.NYT mini crossword answers for January 21, 2025Reddit sports mods, users calling for a ban on X links in postsBest Fire TV Stick 4K deal: Save $15 at Amazon TikTok group chats are finally here Golden Globes: Watch Lily Gladstone's powerful speech for historic win A Masterpiece of Disharmony Redux: The Feeling of an Airplane Crashing by The Paris Review Google taps YouTube stars to hawk its new Pixel phones The Spirit Writing of Lucille Clifton The Ghosts of Newspaper Row by Elizabeth Mitchell Staff Picks: Memorials, Maps, and Machines by The Paris Review Inside the American Snow Dome by Jamaica Kincaid No Walk Is Ever Wasted by Matthew Beaumont Amazon Fire Max 11 tablet deal Cakes and Ale Staff Picks: Trail Mix, Safe Sex, and Conversation Staff Picks: Mammoths, Magazines, and Mysterious Marks by The Paris Review Golden Globes 2024: The complete winners list (Dead) Birds of America by The Paris Review The View Where I Write by John Lee Clark Notes from the Bathysphere by Brad Fox The Art of Distance No. 28 by The Paris Review Verdigris: The Color of Oxidation, Statues, and Impermanence
2.0898s , 8287.046875 kb
Copyright © 2025 Powered by 【sensual eroticism】,Exquisite Information Network