AI Firms Accused of Ignoring Robots.txt and Scraping Content by Lilu Anderson 22.06.2024 AI firms bypassing robots.txt to scrape content spark disputes with publishers like Forbes. Urgent need for clear rules and fair ...