3 Sources
[1]
Major Sites Are Saying No to Apple's AI Scraping
This summer, Apple gave websites more control over whether the company could train its AI models on their data. Major publishers and platforms like The New York Times and Facebook have already opted out. Less than three months after Apple quietly debuted a tool for publishers to opt out of its AI
[2]
Facebook, New York Times, and more, refuse to let Apple Intelligence train on their data
Future expansions to Apple Intelligence may involve more AI partners, paid subscriptions Website owners have a simple mechanism to tell Apple Intelligence not to scrape the site for training purposes, and reportedly major platforms like Facebook and the New York Times are using it. Apple has been
[3]
Many of the biggest websites opted out of Apple Intelligence training
Generative AI systems are trained by letting them surf the web to scrape content. Apple allows publishers to opt out of its scraping, and a new report says that many of the biggest websites have specifically opted out of Apple Intelligence training. This includes both Facebook and Instagram, as
Share
Copy Link
Apple's efforts to train its AI models using web content are meeting opposition from prominent publishers. The company's web crawler, Applebot, has been increasingly active, raising concerns about data usage and copyright issues.

In a significant development for the tech industry, Apple's ambitious plans to enhance its artificial intelligence capabilities are facing resistance from major publishers. The Cupertino-based tech giant has been ramping up its web crawling activities through Applebot, its proprietary web crawler, in what appears to be an effort to gather data for training its AI models
1
.Applebot, which has been in operation since 2015, was initially used to improve Siri and Spotlight search results. However, recent observations indicate a substantial increase in its activity, suggesting a broader scope that likely includes data collection for AI training purposes
1
. This expanded role aligns with Apple's growing interest in artificial intelligence and machine learning technologies.As news of Apple's intensified web crawling spread, several high-profile publishers have taken steps to prevent their content from being used in Apple's AI training processes. Notable names such as CNN, Reuters, The New York Times, and Australian media giant News Corp have implemented measures to block Applebot from accessing their websites
2
.These publishers are utilizing robots.txt files, a standard method for instructing web crawlers on which parts of a website they are allowed to access. By modifying these files, they aim to exclude Applebot specifically, while potentially still allowing access to other search engine crawlers
3
.The pushback from publishers poses a significant challenge to Apple's AI ambitions. Access to diverse, high-quality content is crucial for training robust AI models. With major news outlets restricting access, Apple may face limitations in developing competitive AI products, particularly in areas like natural language processing and content generation
2
.Related Stories
This situation reflects a growing tension in the tech industry between AI companies' need for training data and content creators' rights. Similar controversies have emerged with other AI initiatives, such as those by OpenAI and Google, highlighting the complex issues surrounding data usage, copyright, and fair compensation in the AI era
1
.As of now, Apple has not publicly commented on the publishers' actions or its specific plans for AI development. The company's next moves will be closely watched by the industry, as they could set precedents for how tech giants navigate the delicate balance between innovation and respect for content creators' rights
3
.Summarized by
Navi
[2]
1
Technology

2
Technology

3
Policy and Regulation
