A cookie consent popup appears—can it be extracted?

When trying to extract web data, some websites display a popup asking whether you agree to cookie collection. Even in that case, you can collect web data with Listly. You can ignore the popup asking about cookie collection and collect web data using the normal group extraction feature.

Even if a popup asking you to agree to cookie settings appears like in the example above, there is no need to worry. You can set up automatic clicks so you don't have to close the cookie popup message yourself. In general, popup layers (cookies, promotions, etc.) will have their content fully loaded and displayed in the background without Listly having to click the button through automatic clicks. This is because Listly fetches and collects the HTML. The information already appears in the HTML source even if you don't press the "popup button," so extraction is possible.

However, if a website like The New York Times forcefully displays a popup message and does not reveal the content behind it, extraction becomes difficult. This refers to cases where only part of the article is shown and you must [Continue Reading], log in, or make a payment to see the rest of the information. In such cases, trying to ignore the popup and perform group extraction will fail because the website intentionally does not expose the information. Therefore, it is recommended that you first resolve the popup layer so it disappears before attempting extraction.

Was this helpful?