The rise and fall of robots.txt: As unscrupulous AI companies seek out more and more data, the basic social contract of the web is falling apart.
![](https://incremental.social/media/cache/resolve/entry_thumb/33/2e/332e34fcaaeadcce8486212966c1f0095707352569de1254594efbc1ddc42b58.jpg)
Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!