Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Resubmit sitemaps on every change?
-
Hello Mozers,
Our sitemaps were submitted to Google and Bing, and are successfully indexed. Every time pages are added to our store (ecommerce), we re-generate the xml sitemap.
My question is: should we be resubmitting the sitemaps every time their content change, or since they were submitted once can we assume that the crawlers will re-download the sitemaps by themselves (I don't like to assume).
What are best practices here?
Thanks!
-
Great follow up! Thanks for that. :^)
-
For anybody that is interested in knowing, after 10 days of webmaster monitoring, here are our conclusions:
We have 2 sitemaps (2 languages). It took a few days for Google to re-download the mains sitemap, and a few more days to download the secondary sitemap, however, the new sitemaps were both picked up by Google with no intervention on our part.
Bing, however, has still no downloaded either of the updated sitemaps.
Because it's so easy and isn't seen as bad practice, we will be manually re-submitting sitemap updated to both search engines.
Thanks!
-
Ryan gave an excellent answer. Google is using other clues to pick up on new pages I'm not saying don't submit your sitemap I'm just saying add structured data/schema into your store as well. Check your crawl budget and see if your site is eating up too much of it and not being indexed properly by Google.
A simple test to see if something is being blocked is to run your site through https://varvy.com/
If you do not know, I would stress using Deep Crawl or screaming frog SEO spider
Navigation Is often one of many can cause problems where your site will not be crawled correctly.
To determine whether or not you have to crawl budget issue we got each can make independent image sitemaps and index sitemaps as well just to be sure that Google is getting what you want to.
Like Ryan said check out
https://support.google.com/webmasters/answer/183669
Here is a Magento dynamic site map http://i.imgur.com/QKS0bgU.png
validate your sitemap check it for problems
http://tools.seochat.com/tools/site-validator/
https://outdoorsrank.com/learn/seo/schema-structured-data
http://www.searchmetrics.com/news-and-events/schema-org-in-google-search-results/
https://blog.kissmetrics.com/seo-for-marketplaces-ecommerce/
JSON-LD Microdata
https://builtvisible.com/micro-data-schema-org-guide-generating-rich-snippets/#json
I hope this helps,
Thomas
-
Hello. You can check the Submitted vs Indexed count within Search Console to see whether or not your regenerated sitemap is being picked up already, but resubmitting a sitemap isn't an issue, and fairly easy to do, per Google:
Resubmit your sitemap
- Open the Sitemaps report
- Select the sitemap(s) you want to resubmit from the table
- Click the Resubmit sitemap button.
You can also resubmit a sitemap by sending an HTTP GET request to the following URL, specifying your own sitemap URL: http://google.com/ping?sitemap=http://www.example.com/my_sitemap.xml
Via: https://support.google.com/webmasters/answer/183669 Also from a FAQ in the Webmasters blog they state that, "Google does not penalize you for submitting a Sitemap."
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why have my positions dropped after implementing recommended changes?
Hello! I have taken a Moz free trial and am really enjoying using this service. But, after implementing the recommended changes by Moz my rankings have really dropped. Is this normal? I was averaging around 17 but now averaging 40. Here is my website if anyone has any ideas of what I might be doing wrong, I would greatly appreciate any help.
Technical SEO | | NicoleChambers
Thank you
Nicole1 -
Include or exclude noindex urls in sitemap?
We just added tags to our pages with thin content. Should we include or exclude those urls from our sitemap.xml file? I've read conflicting recommendations.
Technical SEO | | vcj0 -
Robots.txt and Multiple Sitemaps
Hello, I have a hopefully simple question but I wanted to ask to get a "second opinion" on what to do in this situation. I am working on a clients robots.txt and we have multiple sitemaps. Using yoast I have my sitemap_index.xml and I also have a sitemap-image.xml I do put them in google and bing by hand but wanted to have it added into the robots.txt for insurance. So my question is, when having multiple sitemaps called out on a robots.txt file does it matter if one is before the other? From my reading it looks like you can have multiple sitemaps called out, but I wasn't sure the best practice when writing it up in the file. Example: User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-content/plugins/ Sitemap: http://sitename.com/sitemap_index.xml Sitemap: http://sitename.com/sitemap-image.xml Thanks a ton for the feedback, I really appreciate it! :) J
Technical SEO | | allstatetransmission0 -
Adding multi-language sitemaps to robots.txt
I am working on a revamped multi-language site that has moved to Magento. Each language runs off the core coding so there are no sub-directories per language. The developer has created sitemaps which have been uploaded to their respective GWT accounts. They have placed the sitemaps in new directories such as: /sitemap/uk/sitemap.xml /sitemap/de/sitemap.xml I want to add the sitemaps to the robots.txt but can't figure out how to do it. Also should they have placed the sitemaps in a single location with the file identifying each language: /sitemap/uk-sitemap.xml /sitemap/de-sitemap.xml What is the cleanest way of handling these sitemaps and can/should I get them on robots.txt?
Technical SEO | | MickEdwards0 -
Is there a suggested limit to the amount of links on a sitemap?
Currently, I have an error on my moz dashboard indicating there are too many links on one of my pages. That page is the sitemap. It was my understanding all internal pages should be linked to the sitemap. Can any mozzers help clarify the best practice here? Thanks, Clayton
Technical SEO | | JorgeUmana0 -
Host sitemaps on S3?
Hey guys, I run a dynamic web service and I will start building static sitemaps for it pretty soon. The fact that my app lives in a multitude of servers doesn't make it easy to distribute frequently updated static files throughout the servers. My idea was to host the files in AWS S3 and point my robots.txt sitemap directive there. I'll use a sitemap index so, every other sitemap will be hosted on S3 as well. I could dynamically mirror the content from the files in S3 through my app, but that would be a little more resource intensive than just serving the static files from a common place. Any ideas? Thanks!
Technical SEO | | tanlup0 -
How often should I upload a new sitemap in google webmasters?
So I have a real estate website that is regularly changing listings, photos, data. Every time a new listing is added it creates a page for that listing. My question is how frequently should I be recreating a new xml sitemap and uploading it to google webmasters? Thanks in advance.
Technical SEO | | jackaveli0 -
Hosting sitemap on another server
I was looking into XML sitemap generators and one that seems to be recommended quite a bit on the forums is the xml-sitemaps.com They have a few versions though. I'll need more than 500 pages indexed, so it is just a case of whether I go for their paid for version and install on our server or go for their pro-sitemaps.com offering. For the pro-sitemaps.com they say: "We host your sitemap files on our server and ping search engines automatically" My question is will this be less effective than my installing it on our server from an SEO perspective because it is no longer on our root domain?
Technical SEO | | design_man0