How to scrape the web of tomorrow
Web scraping has changed and a plain HTTP request with an HTML parser won't get you far anymore. Let Ondra take you on a journey of the latest tech that his team uses every day for web scraping. Headless browsers, fingerprints, generated headers, residential proxies, mobile app traffic monitoring, and other tools can mean the difference between scraping 10 pages and 10 million pages. And don’t worry, it’s perfectly legal.
Head of Delivery Engineering @ Apify
Ondra may be a hacker of the browser age, but that doesn‘t mean he crashes systems, steals personal data, or trades secrets. Instead, he specializes in extracting terabytes of publicly available data and translating them into a language that machines can understand. At Apify, Ondra leads a team of fellow hackers that helps grow their open source projects, breaks anti-scraping walls, and dabbles in AI.