Only the main content is not visible

As shown above in the error screenshot, if only the site's header and footer are visible and the main content area is not displayed, the following causes may apply.

πŸ“Œ Possible causes

  1. The site actually has no body/main content data*(e.g., when consecutive pages by date have no data on a particular date)*

  2. The connection environment is judged to be different from a normal user, so the loading of the main content is intentionally delayed or blockedin that case

βœ… Solution

  • First, try directly accessing the URL that failed to be crawled to check whether the page actually contains content.

  • If the page shows body content normally when accessed with a regular browser, please refer to the guide below.

  • Increase the [Settings β†’ Wait] time to adjust so that extraction proceeds after the page has fully loaded.

Lower the [Execution Speed] at the top right of the dashboard or [Settings β†’ Group Extraction Speed] to β€˜1’. Increasing the interval between requests can help avoid robot detection caused by excessive requests, which may help.

  • [Settings β†’ Listly Premium Proxy] Try selecting an IP from another country. You may be able to bypass IP blocking and access the page again. Note that this proxy is a shared resource used by all Listly server users, so speed degradation or temporary connection instability may occur.​​

Last updated

Was this helpful?