The Magpie guides, page 3

Step-by-step guides to extracting text, finding pages and pulling web data into the tool you already use — every command in them was run against a live site first, and each one ends where its method breaks and what to switch to.

Magpie title card: Get Price Drop Alerts on Any Website

Get Price Drop Alerts on Any Website

Set a price drop alert on any website: where trackers stop, a page-watch pipeline for the stores they skip, and the threshold you add yourself.

Motherlode Lab · · 10 min read

Magpie title card: Price Scraper: Extract Competitor Prices From Any Store

Price Scraper: Extract Competitor Prices From Any Store

Build a price scraper that pulls competitor prices from any store: JSON-LD extraction, Amazon currency traps, an LLM fallback, and a loop that ships CSV.

Motherlode Lab · · 11 min read

Magpie title card: Proxies for Web Scraping: When You Actually Need Them

Proxies for Web Scraping: When You Actually Need Them

Every guide to proxies for web scraping is written by a proxy vendor. Measured advice: when you need them, when politeness wins, what rotation fixes.

Motherlode Lab · · 10 min read

Magpie title card: Real Estate Scraper: Collect Listings From Any Property Site

Real Estate Scraper: Collect Listings From Any Property Site

A real estate scraper tested against five portals: Zillow listings into CSV in two steps, which sites block you, and legit data routes for the rest.

Motherlode Lab · · 10 min read

Magpie title card: How to Scrape Data From Any Website, over the HTML source of a product listing with prices and stock status

How to Scrape Data From Any Website (No-Code and Code)

Scrape data from website pages with no-code tools, spreadsheet functions, or ten lines of Python. Six methods tested live today, with real timings.

Motherlode Lab · · 12 min read

Magpie title card: Scrape a Documentation Site Into Clean Markdown

Scrape a Documentation Site Into Clean Markdown

A documentation scraper turns a docs site into clean per-page markdown: probe one page, crawl a scoped section, filter the junk, validate what you got.

Motherlode Lab · · 10 min read

Magpie title card: How to Scrape Dynamic Websites, over the HTML source of a product page where the server-rendered section gives way to client-rendered card markup

How to Scrape Dynamic Websites (JavaScript-Heavy Pages)

Get 200 but no content? Four tested routes to scrape dynamic websites: parse embedded JSON, call the hidden API, render in a browser, scroll actions.

Motherlode Lab · · 11 min read

Magpie title card: How to Scrape Email Addresses and Contacts From a Website

How to Scrape Email Addresses and Contacts From a Website

Scrape email from website data without the junk: JSON-LD contacts first, crawl plus regex second, LLM schemas for the rest, plus CAN-SPAM and GDPR rules.

Motherlode Lab · · 10 min read

Magpie title card: How to Scrape a Table From Any Website, over the HTML source of a product listing beside its 200 OK fetch

How to Scrape a Table From Any Website

Scrape a table from any website into Excel, Sheets, or CSV. Four routes tested today, with the pandas 3.0 fix and what breaks on JavaScript tables.

Motherlode Lab · · 10 min read