Can I extract web page data composed of 1, 2, 3,...?

Using Listly Extract data from most web pages in the form of 1, 2, 3...You can do this. The method of splitting and showing content across multiple web pages such as 1, 2, 3... is called pagination. Paid features like Group Extraction, Template and other functions allow you to access individual pages similar to how a person would visit a website and extract the needed data. Basically, if the URLs of the web pages you want to extract data from are distinguishable because they differ from each other, you can easily extract data from multiple web pages using Group Extraction or Templates. Templates are a feature that can reproduce mouse and keyboard actions, and the Listly team designed them to work on most website paginations based on customer cases. Templates will be periodically updated, and Template Pageyou can find four templates related to the most frequently asked-about paginations updated as of August 31, 2023.


How to use a template

1

On the consecutive pages, click LISTLY WHOLE on the “Page 1” to extract the entire set of pages.

2

In the settings section of the extracted data, refer to the template applicable to that website’s pagination and change the data extraction settings accordingly.

Way to access settings 1: Click “Browser Settings” in the topmost box of the results window

Way to access settings 2: Data Board → the gear settings icon for the corresponding task

3

On the Data Board, click the re-extract icon for the corresponding task to run the data extraction again.

However, if the URL does not change when moving from page 1 to page 2 as shown in the image below, you can use Action Script to extract the URL of each individual page you want to scrape and then collect the required data.

Unfortunately, because the Action Script service has been reorganized into an enterprise-only add-on, the Action Script writing service is currently discontinued for the Business plan, which is a single-user license. However, only the development team’s script-writing service has been stopped; the Action Script settings field remains available, so if previously provided code is still functioning normally or you are writing and using your own code, you can continue to use it. If the target website’s structure changes and the Action Script previously provided by the Listly team no longer works, you cannot request a rewrite of the Action Script. We ask for your understanding that we offer template services to assist customers who may face inconvenience due to this.

Was this helpful?