Websites clamp down as creepy AI crawlers sneak around for snippets
Shrinks training pool, but hurts services like the Internet Archive
The internet is becoming significantly more hostile to webpage crawlers, especially those operated for the sake of generative AI, researchers say.…