Group Extraction - Generate 1,2,3…Sequential Page URLs

Check the URL pattern

As you click through page numbers on the web page you want to extract, watch how the URL changes. In most cases, only the number after page= changes. (Page 1 may have the parameter omitted.)

https://www.example.com/categories/420186/?sort=latest

https://www.example.com/categories/420186?page=2\&sort=latest

https://www.example.com/categories/420186?page=3\&sort=latest

Using this principle, you can easily create pagination addresses for all pages with a single URL.

Use an automatic URL generation tool

A. Use conversational AI service ^recommended

You can easily generate sequential page addresses using LLM-based conversational AI services like ChatGPT. After checking the page URL pattern like the example page below, try saying "Create URL addresses with Page number from 1 to 30".

B. Use URL builder

Search "sequential url generator" or "url builder" in Google or other search engines to find various free web tools. This guide uses Online Sequential Number, URL & Text Generator as an example. (If you understand URL structure, you can easily create them with Excel formulas too.)

When you go to the service link, this screen appears:

Set options like the example below to generate sequential page URLs:

Example URL: https://www.example.com/categories/420186?page=2\&sort=latest

Enter the options as follows and click the Generate button:

• Enter the unchanging part before the page number.

• Enter the starting page number. (Page 1 often has parameters omitted, but entering page=1 still works fine.)

• Enter the ending page number.

• Enter the increment step. Usually it's 1,2,3... sequential, so enter 1.

• Enter the unchanging part after the page number. Leave blank if there isn't one.

Use the results

Once URLs are generated sequentially based on your input range, copy the generated addresses and paste them into Group Extraction to extract multiple pages at once.