# Enterprise - Auto-Scrape Sub Pages

## What is Automatic Subpage Collection?

<figure><img src="/files/0ef28d3f1011068a91398ff4a804c23b7d3cb74d" alt=""><figcaption></figcaption></figure>

When new posts or products appear on a list page, the subpage URLs are automatically added to the group and extraction proceeds. With automatic subpage collection, you don't need to manually gather or update addresses one by one—you can **automatically detect updated lists and collect new data**.

This feature is especially useful when extracting **continuously updated pages like posts or product pages**. For example, if you connect a shopping mall list page where new products are registered daily, new product detail pages will be automatically collected, **maintaining the latest data state**.

{% hint style="success" %}
**What is a Subpage?**

Subpages refer to all subordinate pages excluding the website's main page (homepage).
{% endhint %}

***

## How to Use

{% stepper %}
{% step %}

### Create Parent Task

* Run Listly on the list page and click the **\[Parts]** button.

<figure><img src="/files/8d73a09ffe4852a2e485e81095d4b1a2ee84eeaf" alt=""><figcaption></figcaption></figure>

* After selecting the extraction area, choose **'Hyperlink'** in the extraction options to collect only links to each detail page.

<figure><img src="/files/bbe43d77c0c3d6686ebed9ca29e3c0fbe0686969" alt=""><figcaption></figcaption></figure>

* **This task that collected only detail page hyperlinks is the parent task needed for 'automatic subpage collection'.** The URL of this task will be used later when connecting the child task, so copying it in advance will be convenient.

<figure><img src="/files/43dd3fc308c3896760b8589e6c58fdae0dfeb139" alt=""><figcaption></figcaption></figure>
{% endstep %}

{% step %}

### Create Child Task and Connect to Parent Task

* On the detail page, select the area that will serve as the reference for group extraction and extract data.\
  (This process is the same as regular [Group Extraction](/getting-started/result-page-features/group-extraction.md).)

<figure><img src="/files/acf9dfa2128feb7bceea352c39621170443e95b1" alt=""><figcaption></figcaption></figure>

* On the results page, check the tab where the selected data is located, then click the **\[+Group]** button.

<figure><img src="/files/b9d1ceb0f3c0004f0fa33410900e62f26bd0d0e3" alt=""><figcaption></figcaption></figure>

* In the URL input field at the bottom of the group extraction settings window, select **\[Choose URL from existing task]** and paste the URL of the parent task you created earlier.

<figure><img src="/files/2a628494fe5e8554ce05b31ccda3d0383ae10b53" alt=""><figcaption></figcaption></figure>

* Click the **\[Preview]** button and select the column containing detail page URLs. If 5 URLs appear in the bottom preview window, it's working correctly. After confirming, click the **\[Done]** button.

<figure><img src="/files/b25dc928fec6968230e4741aba06bfc4136f3577" alt=""><figcaption></figcaption></figure>

![](/files/b5e144002f0d4b6c96b51f411f4afe3ad61ec912)

* When you register a group this way, the child task (detail page group extraction task) is connected under the parent task (hyperlink collection task). Whenever the parent task discovers new links, those URLs are automatically added to the child task and collection proceeds. Therefore, set the schedule on the **parent task**.

<figure><img src="/files/ee45ef74c546d574931f598754863d462f061239" alt=""><figcaption></figcaption></figure>

* Set the schedule according to your desired frequency and time period.

<figure><img src="/files/ffd63cb49cee225867e2ea646998516ad86ff740" alt=""><figcaption></figcaption></figure>

* When the parent task runs according to the set schedule, if new items are registered on the list page, those URLs will be automatically updated in the child group.

<figure><img src="/files/0481f7c3bf0c20cb3a4494fe75e119aeba09ec89" alt=""><figcaption></figcaption></figure>

<figure><img src="/files/d6d98bca58d0eda496deb9b2d4e557be5c577f06" alt=""><figcaption></figcaption></figure>
{% endstep %}
{% endstepper %}

{% hint style="warning" %}
**Important Notice**

The automatic subpage extraction feature is not a new post detection feature, but operates based on **automatic extraction method that runs according to schedules**. When the parent task runs according to the user-registered schedule, if new content is found on the list page, those links are automatically added to the child task and collection proceeds.
{% endhint %}


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://help.listly.io/getting-started/enterprise-solutions/auto-scrape-sub-pages.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.