Skip to content
The Register

14 extractors

SEO tools

Sitemaps, structured data, broken links and technical SEO.

14 extractors

003seo tools / developer tools

Sitemap URL Extractor — Every URL From Any Sitemap

Extract every URL from a site's sitemaps — follows sitemap-index files, reads robots.txt to discover them, decompresses .gz sitemaps, and returns lastmod/changefreq/priority. Feeds any other scraper. Pure logic.

url
lastmod
changefreq
+2 more
5 fields60 runs
005seo tools / business

Google Trends Full Scraper — Interest & Related

Interest over time, related queries and topics, and interest by region for up to 5 compared keywords. Handles rate limits with backoff + proxy, and flags every incomplete-period data point instead of returning it silently.

type
keyword
date
+5 more
8 fields56 runs
011seo tools / developer tools

Broken Link Checker — Honest Link Health

Crawl your pages and check every link's HTTP status. Reports broken links (404/410/5xx/DNS) separately from blocked (403/429) and redirects, with the source page — so a login-walled link is never falsely flagged as broken.

sourcePage
url
anchorText
+5 more
8 fields49 runs
017developer tools / seo tools

Wayback Machine Scraper — Website History & Snapshots

Extract every Wayback Machine (archive.org) snapshot of any URL, domain or subdomain — capture date, HTTP status, MIME type, content digest, byte size and direct snapshot links. Up to 50,000 rows, many URLs per run, $0.50 per 1,000 rows. No API key.

inputUrl
timestamp
capturedAt
+6 more
9 fields46 runs
018seo tools / developer tools

AI Crawler Audit — Are You Blocking ChatGPT?

Check whether your site is visible to AI search or accidentally blocking it. Audits robots.txt for GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and 7 more, detects llms.txt, and returns an AI-readiness score with the exact fixes. No key, no login.

domain
aiReadinessScore
aiSearchReadiness
+11 more
14 fields45 runs
019news / seo tools

Google News Scraper — Search, Topics & RSS Feeds

Fetch Google News articles by keyword search or topic (title, source, link, date, snippet) via the public RSS feed — deduplicated, newest-first, with keyword and age filters. No API key.

query
title
source
+5 more
8 fields45 runs
022seo tools / business

Website Audit — In Plain English, Not Scores

Audit any list of websites and get findings a business owner actually understands: what is wrong, what it costs them, and the exact fix. Every row ships a paste-ready summary for a client email. No browser, no API key, no anti-bot.

domain
url
auditStatus
+17 more
20 fields43 runs
024seo tools / news

Google Trends Daily Searches — The Endpoint That Doesn't 429

Today's trending searches for 60+ countries, with the news stories driving each one. Uses Google's RSS feed, which does not rate-limit — so runs don't fail the way explore-API scrapers do.

geo
term
approxTraffic
+4 more
7 fields42 runs
035seo tools / developer tools

Broken Link Resurrector — Dead Links & Fixes

Finds broken links on your pages and, for each one, suggests the fix: the last working capture from the Internet Archive, whether the site itself still exists, and the exact next action. A report you can act on, not a list of 404s.

url
anchorText
foundOn
+14 more
17 fields34 runs
049seo tools / developer tools

URL Metadata & Open Graph Extractor — Link Previews

Fetch URLs and extract clean, unified metadata — title, description, Open Graph and Twitter card tags, canonical, favicon — with relative URLs resolved to absolute and per-URL status. Ideal for link previews and content pipelines.

url
title
description
+6 more
9 fields29 runs
051seo tools / developer tools

Structured Data Extractor — JSON-LD / Schema.org

Extract JSON-LD / schema.org structured data from web pages — product price & rating, article author & date, org info, and the raw objects. Great for SEO audits and rich-result checks. No auth.

raw
type
note
+4 more
7 fields28 runs
055seo tools / marketing

Keyword Suggest — Google, YouTube, Bing, Amazon

Harvest autocomplete keyword suggestions from Google, YouTube, Bing and Amazon — with optional A-Z and prefix expansion for deep keyword research. Public endpoints, no API key.

engine
seed
suggestion
3 fields27 runs
056seo tools / developer tools

Redirect Tracer — Follow the Full Redirect Chain

Trace the full redirect chain of any URL hop by hop — every status code and Location, the final destination, redirect count, and chain type (http-to-https, loop, direct). No auth.

startUrl
finalUrl
finalStatus
+3 more
6 fields27 runs
082ai / seo tools

Jev SEO Topic-Gap Reviewer — Find Content Gaps

Review supplied SEO query, page, and content context for intent alignment and duplicate risk using a TypeSafe Jev key. It does not retrieve rankings or volume.

state
questions
index
+9 more
12 fields19 runs