Skip to main content

AI Bots — Who is Blocking and Why?

Are you considering blocking AI bots? Perhaps you think it's crazy but want to see who it is. Tom Capper digs into the robots.txt of major sites to reveal who is blocking AI bots.

Comments

Popular posts from this blog

Where Can You Go to Learn Local SEO?

Image credit: Fattoria la Maliosa In 2023, I’ll have been studying local SEO for 20 years, and I definitely still won’t know it all. If you’re just entering this fine and spacious field of local search marketing, welcome to what will be a habit of lifelong scholarship. In the next 20 years, you’ll see as many (or more) changes than we’ve witnessed in the nascent decades of this discipline. You’ll study how to lay a feast of options before the local businesses you market, regularly setting out new dishes as new promotional opportunities arise. Your education is what will keep this buffet fresh and hot while keeping you enthusiastic about your work. Here’s the view from my side of the table of what’s happened culturally over the past two decades in the industry: we started out from a real place – marketing quite actual local businesses – and have come to prize their qualities of realness more with each passing year as we’ve learned to prioritize owner expertise, their earned authori...