Does CDN Support Direct Origin Pull Through Crawler Access?
No.
CDN cannot distinguish normal user access from crawler access. If the crawler records the IP address of a point of presence (PoP), the crawler can directly access that IP address next time. If the PoP is malfunctioning or undergoing routine maintenance, the crawler will be unable to pull content from that IP address.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.