Cloudflare's "Scrape Shield"

Website, Application, Performance Security
1

Cloudflare offers under the topic “Scrape Shield” and “Server-side Excludes” the possibility to “Automatically hide SPECIFIC content from disreputable visitors.”

With the example:

<!--sse-->Disreputable visitors won't see this<!--/sse-->

By using <!--sse-->...<!--/sse--> Can I hide only 1-2 sentences or can I basically hide the whole content of the website?

Questions:
a) For example, would below code snippet work?
b) Can Google bots, etc still read and index the content?

<!--sse-->
<article> My main website content. </article>
<!--/sse-->

Thank you

2

Why would you think only one or two sentences?

https://support.cloudflare.com/hc/en-us/articles/200170036-What-does-Server-Side-Excludes-SSE-do- seems pretty clear about that

Wrap any content that you want to be excluded from suspicious visitors

Does it not work for you?

3

OK. Thank you.
In the help-section under “Server-side Excludes” it isn’t that clear.

Then we come to the second part: can Google, etc spiders still crawl the website without any risk?

4

As long as Google is not considered a suspicious visitor, they should get the content as-is.

5

Exactly: can someone from Cloudlfare please confirm that Search Engings are not considered to be “suspicious visitor”

6

For that you might want to open a support ticket, but generally Google is not considered such a type of visitor :wink:

7

Here we are, they are all white listed:
https://support.cloudflare.com/hc/en-us/articles/200172866-Does-Cloudflare-challenge-or-block-search-engine-bots-or-crawlers-

8

This topic was automatically closed after 30 days. New replies are no longer allowed.