Help Center/ Web Application Firewall/ User Guide (Kuala Lumpur Region)/ FAQs/ Protection Rule Configuration/ Anti-Crawler Protection/ Why Is the Requested Page Unable to Load After JavaScript Anti-Crawler Is Enabled?
Updated on 2024-03-14 GMT+08:00
View PDF
Share

Why Is the Requested Page Unable to Load After JavaScript Anti-Crawler Is Enabled?

After JavaScript anti-crawler is enabled, WAF returns a piece of JavaScript code to the client when the client sends a request. If the client sends a normal request to the website, triggered by the received JavaScript code, the client will automatically send the request to WAF again. WAF then forwards the request to the origin server. This process is called JavaScript verification. Figure 1 shows how JavaScript verification works.

Figure 1 JavaScript anti-crawler detection process
  • To enable the JavaScript anti-crawler protection, the browser on the client must have JavaScript and cookies enabled.
  • If the client does not meet the preceding requirements, only steps 1 and 2 can be performed. In this case, the client request fails to obtain the page.

Check your services. If your website can be accessed by other means except for a browser, disable JavaScript anti-crawler protection.

Parent topic: Anti-Crawler Protection