Test sites and challenges to learn web scraping
Below is a list of demo Websites/Pages to scrape
Ecommerce
Ecommerce playground to scrape products and shop-related data.
See Page
Pagination
Huge list of items in a paginated system
See Page
Load More
Load more items by clicking the 'load more' button
See Page
Infinite Scrolling
Infinite scrolling displays more items as you scroll down.
See Page
Login
Login with username/email and password to see items.
See Page
Login & CSRF
Login with CSRF-token to see protected items.
See Page
Login & Cloudflare
Bypass Cloudflare protection and Login to see protected items.
See Page
Login & Cloudflare Turnstile
Login and pass Cloudflare Turnstile to see protected items.
See Page
JavaScript Rendering
Enable JavaScript to see items.
See Page
Table Parsing
Extract structured product data from the HTML table.
See Page
Cloudflare Challenge
Bypass the Cloudflare challenge.
See Page
Antibot Challenge
Bypass the Antibot challenge.
See Page