

27·
1 year agoWhy should the crawler be blockable? That only brings disadvantages for a search engine. There is no sensible reason to allow Google but exclude other search engines.


Why should the crawler be blockable? That only brings disadvantages for a search engine. There is no sensible reason to allow Google but exclude other search engines.


I agree that Brave is problematic and most of the criticisms are also legitimate. But the point about the crawlers is not really a problem. If you respect the wish of websites to be indexed exclusively by Google, you support Google’s monopoly and prevent alternative search engines from having similarly good results.
There is an extension that bypass all the paywalls that 12ft was able to and some more. It’s banned in both chrome addon store and firefox addon store https://gitflic.ru/project/magnolia1234/bypass-paywalls-firefox-clean