AI training datasets
Latest stories covering AI training datasets, with summaries and links to related coverage.
1 stories · 1 reports · page 1 of 1
0 stories · 0 reports in the last 7 days
Latest report · Counts as of (UTC)
Models in this coverage
No tracked models are linked to this topic’s reports in the last 30 days.
No established topics share multiple stories with this topic yet.
Latest stories
Ex-Meta Researcher Torrented Pirated Books, Deleted It 'Due to Litigation'
news
5 min read
Former Meta researcher Stephen Roller testified in a deposition that he torrented The Pile, a dataset that includes the pirated Books3 collection of nearly 200,000 books, according to rightsholders suing Meta in California federal court. The plaintiffs say Roller admitted knowingly distributing the material and said Meta had copies of Books3 when he left its FAIR AI research group. Roller worked at Meta from 2017 to 2023 and later deleted his personal copy, saying litigation made it contentious to keep copies of The Pile, the plaintiffs state. Meta disputes that the testimony proves Roller downloaded the dataset for Meta or while acting for Meta. The company says Roller could not recall when he downloaded it and testified it might have been for himself or another employer. Meta also says the deleted copy was on Roller’s personal computer and was removed more than two years after he left because he no longer needed it. Meta admitted in early 2024 that it used portions of Books3 to train Llama 1 and Llama 2, without specifying how it obtained the dataset. A prior ruling found training Llama on books to be fair use, leaving alleged BitTorrent downloads as a central unresolved issue. The plaintiffs also seek records related to an internal “ML Books” folder, a possible employee book club, and missing torrent-server command histories. Entrepreneur Media’s case is scheduled for trial in spring 2027.