Scrapers for popular websites, tested as written.

Step-by-step playbooks for scraping one site at a time — what the site serves, the route that survives it, and where each method breaks. Every command was run against the live site first.

Magpie title card: Amazon Price Scraper: Track Price Changes Automatically

Amazon Price Scraper: Track Price Changes Automatically

An Amazon price scraper that alerts on real changes: tested watch commands, the no-threshold limit, and a cron recipe for price-below-X alerts.

Motherlode Lab · · 8 min read

Magpie title card: Google News Scraper: Collect Headlines by Topic

Google News Scraper: Collect Headlines by Topic

A Google News scraper that works in 2026: pull topic, search, and geo RSS feeds in one command, export headlines to CSV, and dodge three tested traps.

Motherlode Lab · · 8 min read

Magpie title card: Google Search Scraper: Extract SERP Results to CSV/JSON

Google Search Scraper: Extract SERP Results to CSV/JSON

Live-tested google search scraper routes - direct scraping fails, Serper and SerpApi keys work, a free zero-key path, plus jq to finish as CSV.

Motherlode Lab · · 11 min read

Magpie title card: LinkedIn Scraping: What's Public, What's Allowed, and How

LinkedIn Scraping: What's Public, What's Allowed, and How

LinkedIn scraping tested October 2026, with real commands and output. What loads without login, what the courts and ToS say, and where each limit sits.

Motherlode Lab · · 9 min read

Magpie title card: Reddit Scraper, over the HTML source of product cards with a product link highlighted

Reddit Scraper: Posts, Comments & Subreddits

A reddit scraper guide with three tested routes to posts, comment trees and subreddit data: free API credentials, the public JSON ladder, browser fallback.

Motherlode Lab · · 10 min read

Magpie title card: Trustpilot Scraper: Reviews & Ratings

Trustpilot Scraper: Reviews & Ratings

A trustpilot scraper tested live in 2026: the JSON-LD route returns 20 reviews per business with no API key, plus what robots.txt and the ToS say.

Motherlode Lab · · 9 min read

Magpie title card: Yahoo Finance Scraper: Prices & Fundamentals (Tested)

Yahoo Finance Scraper: Prices & Fundamentals (Tested)

A yahoo finance scraper guide tested live: keyless chart endpoint for prices, crumb-auth quoteSummary for fundamentals, server-rendered pages, watch mode.

Motherlode Lab · · 9 min read

Magpie title card: YouTube Scraper: Videos, Channels & Metadata

YouTube Scraper: Videos, Channels & Metadata

Tested youtube data scraper routes on live videos: one command returns title, author, views and duration with no API key, plus the bulk CSV loop.

Motherlode Lab · · 9 min read

Magpie title card: Zillow Scraper: Listings, Prices & Zestimates

Zillow Scraper: Listings, Prices & Zestimates

A working Zillow scraper: pull listings, prices, and beds from Zillow's JSON-LD for free, plus robots rules, ToS limits, and the Zestimate gap.

Motherlode Lab · · 9 min read