Web Scraping with Python & Selenium: Data Collection, Excel Export & Automation

In this one-day training, you'll learn the fundamentals of web scraping and build your own scraper step by step in Python. You'll practise analysing websites, retrieving data, and handling common challenges such as pagination, dynamic content, and IP blocks. The focus is entirely on hands-on learning, so you can apply everything directly in your own work, from collecting data to exporting it to Excel or CSV.

What you'll learn

• What web scraping is and when to use it.
• Working with HTTP requests and HTML structures.
• Extracting data with BeautifulSoup.
• Saving data to CSV or Excel.
• Introduction to scraping dynamic websites with Selenium.
• Ethical and legal principles around web scraping.

After this course you'll be able to:

• Build a simple web scraper in Python.
• Efficiently collect and store online data.
• Debug and resolve common scraping problems.
• Recognise when scraping is and isn't permitted.

Who is this for

• Data analysts, researchers, and marketers.
• Professionals who want to collect online data without manual copying.
• Anyone looking for a practical introduction to web scraping with Python.

Prerequisites

• No scraping experience required.
• Basic knowledge of Python is recommended, but not required.

Programme

Part 1 – Introduction to Web Scraping

• Use cases, possibilities, and limitations.

Part 2 – Understanding Web Pages

• HTTP requests, HTML structure, and browser inspection tools.

Part 3 – Extracting Data with Python

• Using Requests and BeautifulSoup to retrieve and parse data.

Part 4 – Saving Data

• Exporting scraped data to CSV and Excel.

Part 5 – Dynamic Websites and Selenium

• Introduction to scraping JavaScript-driven pages.

Part 6 – Robust Scraping in Practice

• Pagination, error handling, IP blocks, and scraping responsibly.

Part 7 – Ethical and Legal Aspects

• Robots.txt, terms of service, best practices, and Q&A.