Quickly export the URLs from an XML Sitemap

Upload XML Sitemap file Location to Screaming Frog

Last updated on July 20th, 2022 at 02:29 am

Ever want to know how many pages are in an XML sitemap or XML sitemap index? The list mode feature in Screaming Frog will let you know how many linked sitemaps there are, how many total valid URLs they include and allow you to export the entire list to a file or Google sheet.

To get the number of sitemap files and URLs in XML sitemaps you must first set up Screaming Frog with the location of the XML Sitemap files. Then you can bulk export the queued URLs to get the full list of URLs without having to crawl every single page.

Time needed: 5 minutes

Uploading XML Sitemap File or Index to Screaming Frog

  1. Reset to the default configuration

    Go to menu: File > Configuration > Clear default Configuration

  2. Set to list mode

    Go to menu: Mode > List

  3. Open crawl configuration settings

    Upload the XML Sitemap or XML Sitemap Index location to Screaming Frog and click OK.Upload XML Sitemap file Location to Screaming Frog

    At the top of the window titled “Reading file”, the output shows you the number of linked sitemaps that is being downloaded. When you scroll to the bottom of the output you will see the number of URLs that were found.
    Linked sitemaps and url output in Screaming Frog

    To export the list of URLs Screaming frog located in the Sitemap or Sitemap Index you will need to export the queued URLs. Proceed to Step 4 below.
    Number of URLs in XML output

  4. To Export Queued URLs in Screaming Frog

    Click “OK” when the file is done being read and you have noted the number of URLs and sitemap files.

  5. Quickly Pause the Crawl

    Quickly click the “Pause” button on the crawler before it starts to process any URLs

  6. Go to “Bulk Export” Menu

    Click the “Bulk Export” menu and select “Queued URLs”.Click the “Bulk Export menu and select Queued URLs

  7. Enter export preferences and click save

    Screaming Frog will prompt you for the name, file type and location of the URL export file.Export settings for screaming frog
    If Screaming Frog processed any URLs before you paused the crawl, you will want to make sure to add those URLs to your queue list.

You are welcome to give feedback or ask questions. Would love to hear from you!

By Eric Mandell

Eric Mandell is a an SEO professional since 1999 and is currently a Director of SEO at Catalyst Performance Marketing Services out of Boston.

Leave a comment

Your email address will not be published. Required fields are marked *