TidyData APIsAll APIsPricing

Sitemap URL Extractor API

Get all URLs of a website from its sitemaps (found via robots.txt), following sitemap indexes and .gz files, with lastmod, priority and changefreq. Filter by text.

Authentication & base URL

Subscribe through one of our marketplace listings; your marketplace API key and base URL are shown there. All endpoints return JSON over HTTPS, served from a global edge network (typically 20–150 ms).

Subscribe on RapidAPI

Endpoints

GET /v1/sitemap

Extract sitemap URLs

ParameterInDescriptionExample
url *queryWebsite or sitemap URLhttps://apify.com
limitqueryMax URLs (1-5000)1000
containsqueryOnly URLs containing this text

Example

GET /v1/sitemap?url=https%3A%2F%2Fapify.com&limit=1000&contains=

{
  "site": "https://apify.com",
  "sitemaps": [
    "https://apify.com/sitemap.xml",
    "https://apify.com/sitemap/pages.xml"
  ],
  "count": 1000,
  "truncated": true,
  "urls": [
    {
      "url": "https://apify.com/",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/about",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/actors",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/ai-agents",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/ai-agents/ai-agent-marketplace",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/alternatives",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/alternatives/bardeen-alternatives",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/alternatives/brightdata-alternative",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/alternatives/brightdata-alternative-for-facebook-data",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
      "url": "https://apify.com/alternatives/browseai-alternatives",
      "lastmod": null,
      "changefreq": null,
      "priority": null
    },
    {
  …

Get all URLs of a website from its sitemaps (found via robots.txt), following sitemap indexes and .gz files, with lastmod, priority and changefreq. Filter by text.

Use cases

SEO crawls, content inventories, site migrations, change monitoring, feeding crawlers and AI pipelines.

Why this API

Pricing

Free plan with 500 calls per month, then Pro (25,000 calls for $4.99/month) and Ultra (150,000 calls for $14.99/month). See all plans.