Test sites and challenges to learn web scraping

Below is a list of demo Websites/Pages to scrape

Ecommerce

Ecommerce playground to scrape products and shop-related data.

See Page

Pagination

Huge list of items in a paginated system

See Page

Load More

Load more items by clicking the 'load more' button

See Page

Infinite Scrolling

Infinite scrolling displays more items as you scroll down.

See Page

Login

Login with username/email and password to see items.

See Page

Login & CSRF

Login with CSRF-token to see protected items.

See Page

Login & Cloudflare

Bypass Cloudflare protection and Login to see protected items.

See Page

Login & Cloudflare Turnstile

Login and pass Cloudflare Turnstile to see protected items.

See Page

JavaScript Rendering

Enable JavaScript to see items.

See Page

Table Parsing

Extract structured product data from the HTML table.

See Page

Cloudflare Challenge

Bypass the Cloudflare challenge.

See Page

Antibot Challenge

Bypass the Antibot challenge.

See Page