Skip to content

Developer Platform

Search docs & API
/
Log in
Sign up

Control Pinterestbot access to your site

Pinterestbot crawls your public website and indexes your content to drive traffic back to your site. It also scrapes content to keep Pin details up to date and to detect and remove broken links behind Pins.
The bot is configured to rate-limit concurrent requests made to your site. You can control whether, and how, Pinterestbot accesses your site to optimize server resources, content management, and SEO analytics.

Verify authenticity of Pinterest bot

To visit your site, Pinterestbot sends a valid user agent from a Pinterest-owned network:
Pinterest/0.2 (+https://www.pinterest.com/bot.html) Mozilla/5.0 (compatible; Pinterestbot/1.0; +https://www.pinterest.com/bot.html) Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Pinterestbot/1.0; +https://www.pinterest.com/bot.html)
Pinterestbot typically uses US-based, dynamic IP addresses in the range of 54.236.1.XXX. It may also use non-US addresses, which have no fixed range, to support localized data.
These addresses change without notice, so use DNS verification instead of IP address lookup to verify authenticity of our bot:
  1. Use the host command to run a reverse DNS lookup on the IP address in the client's HTTP request from your logs:
    host [ip_address]
  2. Verify that the domain name in the response ends with pinterest.com or pinterestcrawler.com.
  3. Use the host command to run a forward DNS lookup on the response from the preceding step.
  4. Verify that it matches the IP address from the preceding step.
If you receive a consistent volume of traffic from a client sending a valid Pinterest user agent that does not pass the DNS verification test, contact us.
Do not hardcode Pinterestbot IP addresses in your site configuration, because Pinterest changes them frequently without notice.
Do not hardcode Pinterestbot IP addresses in your site configuration, because Pinterest changes them frequently without notice.

Restrict or limit Pinterestbot access

The bot obeys the Robots Exclusion Standard (robots.txt). To modify the behavior of Pinterestbot, edit your site's robots.txt file. Pinterest may temporarily cache robots.txt for performance reasons, so, Pinterest bot traffic may take time to reflect any changes to the file.
Make sure the file is located in the root directory of your site domain as a standard best practice. The file should be accessible at https://www.[your-site].com/robots.txt.
Avoid blocking access to robots.txt, which could prevent pinterestbot from understanding your crawl rules and cause indexing errors or unintended content exposure.
Avoid blocking access to robots.txt, which could prevent pinterestbot from understanding your crawl rules and cause indexing errors or unintended content exposure.

Set a crawl delay

The Crawl-delay directive indicates how many seconds the bot should wait between successive requests to your website. We honor delays up to 1 second for most Pinterest-initiated crawling traffic. We treat greater values as 1 second.
Longer delays slow down the crawler's ability to access and process your site’s content, which is necessary for distributing and recommending that content to Pinterest users .
user-agent: Pinterestbot Crawl-delay: 0.2
If you need a longer crawl delay, contact us.

Restrict Pinterestbot from crawling your entire site

user-agent: Pinterestbot disallow: /

Restrict Pinterestbot from crawling specific paths

user-agent: Pinterestbot disallow: /[directory1]/

Let Pinterestbot crawl subpaths within blocked paths

user-agent: Pinterestbot disallow: /{directory1}/ allow: /{directory1}/{subdirectory1}/

Set multiple robots.txt parameters

The following is an example a robots.txt file with multiple parameters:
user-agent: Pinterestbot disallow: /directory1/ allow: /directory1/subdirectory1/ crawl-delay: 0.2

Get help

If you have questions about Pinterestbot or need help with controlling its access, contact Support.
To submit an API Support request:
  1. Go to How can we help? in Help Center.
  2. Type API in the search box. The search is not case sensitive.
  3. Select API Technical Support from the results.
  4. Click Still need more help?
  5. Enter and submit the requested information.
Was this page helpful?