General Discussion • Re: wtf? almost every forum and website is on cloudflare now?

I don't understand why people always talk about attacks when it comes to bots. In reality, any bot is an extension of a person. We shouldn't forget that. The purpose of using bots is important here. If a person wants to get a copy of a website, for example, to avoid the risk of it suddenly disappearing (everyone's familiar with this situation), and it contains valuable information, then this desire is not malicious. Moreover, I've seen links on some websites for downloading all the contents as an archive, and I think that's good form. It would be good to create a special line in robots.txt for this purpose. If the goal is to deliberately overload the server with requests, then that's malicious intent, and that's a completely different matter. If search engines crawl a website to index content, or a robot collects information to train AI, there's nothing malicious about it. After all, most people use search engines, and many use AI. I don't see anything wrong with that.