Skip to content
The Register

Sitemap URL Extractor — Every URL From Any Sitemap

Extract every URL from a site's sitemaps — follows sitemap-index files, reads robots.txt to discover them, decompresses .gz sitemaps, and returns lastmod/changefreq/priority. Feeds any other scraper. Pure logic.

Sitemap URL Extractor — Every URL From Any Sitemap returns 5 documented output fields, including url, lastmod, changefreq, priority and sitemap. Every field carries a declared type, a written description and an example value. 60 runs are recorded on Apify.

Run it on ApifyPay per result · no subscription
5
Output fields
7
Inputs
60
Runs
2026-10-15
Last run

01 — output

What it returns

Every field the extractor writes to its dataset, with its type, a written description and an example value.

FieldTypeWhat it holdsExample
urlstringnullThe URL this row describes.https://example.com/pricing
lastmodstringnullLast-modified date the sitemap declares.<lastmod>
changefreqstringnullChange frequency the sitemap declares.<changefreq>
prioritystringnullPriority the sitemap declares, between 0.0 and 1.0. Higher means the page is considered more important relative to others on the site.high
sitemapstringnullSitemap URL this row came from.<sitemap>

02 — sample

One record

Assembled from the example values declared on the schema above, not invented at render time.

{
  "url": "https://example.com/pricing",
  "lastmod": "<lastmod>",
  "changefreq": "<changefreq>",
  "priority": "high",
  "sitemap": "<sitemap>"
}

03 — input

What you give it

InputTypeDescription
siteUrlstringoptionalA site to extract sitemaps from — standard locations (sitemap.xml, sitemap_index.xml) and robots.txt are tried automatically.
sitemapUrlsarrayoptionalExact sitemap URLs to parse, if you already know them (index or urlset, .xml or .xml.gz).
urlIncludesarrayoptionalKeep only URLs containing one of these substrings (e.g. /blog/).
urlExcludesarrayoptionalDrop URLs containing any of these substrings.
maxUrlsintegeroptionalHard cap on URLs returned. Strictly enforced.
maxSitemapsintegeroptionalCap on how many sitemap files to fetch (for huge sitemap-index sites).
useProxybooleanoptionalRoute through a proxy for sites that block datacenter IPs.

04 — run

Run Sitemap URL Extractor on your own input

It runs in the cloud on Apify. Nothing to install, and you are billed per result returned rather than per attempt.

Open on Apify ↗

05 — questions

Asked before running it

5 of 5 fields described

What does Sitemap URL Extractor — Every URL From Any Sitemap return?
It returns 5 documented output fields: url, lastmod, changefreq, priority and sitemap. Each field declares its type, a description of what it holds, and an example value.
What input does Sitemap URL Extractor — Every URL From Any Sitemap take?
All 7 inputs are optional and ship with usable defaults, so it runs as-is. They are listed with their types below.
Does Sitemap URL Extractor — Every URL From Any Sitemap need an API key or login?
No. None of its inputs is a credential, and it reads only public data. Nothing to sign up for before the first run.
How do I run Sitemap URL Extractor — Every URL From Any Sitemap?
It runs on Apify. Start it from its listing with the inputs above, or call the Apify API with the Actor's ID. Results land in a dataset you can export as JSON, CSV or Excel, or read through the Apify API into your own pipeline.