Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Top of funnel google ads campaign not hardly converting, why?
Hi, I really hope someone can help me with this. I'm running two search ad campaigns and a google shopping campaign in google ads. The search campaigns are targeting top-of-funnel keywords as the business doesn't have universally known collections which everyone would search for so they are just unique to my business. So the campaigns are driving traffic but really converting whereas google shopping is converting because searchers are looking for particular products so they're lower down the funnel closer to aking a purchase decision. I feel I've optimised the campaign well and for the most part, most keywords have 7/10 quality score. The landing page seems fine. However, our offering wasn't as strong as competitors so we've offered a discount the same as them to compete. Since I started google ads we have nearly doubled our monthly revenue and the product types targeted in campaigns have increased in quantity sold so it seems it's having an effect but the campaigns aren't showing a good performance. Does anyone have any suggestions or input that could help me? I looked at first interaction attribution model and even there it's not performing well which makes this even more difficult to resolve. I'm thinking I should enable USER id feature in Google analytics so i can track signed in users across devices which may then help attribute sales to paid search channel as I saw in search console that the keyword that generates the most traffic to the site is our brand name and we're not a well-known brand so makes me think they may be starting their buyer's journey on a work computer on their mobile and finishing on their computer at home as an example. However, I don't believe this will be the main cause or solution as I would only have data for signed in users which still won't give me the full picture. Also if the campaign is optimised effectively but conversions are minimal could not having many conversions affect quality score? If someone can help or provide me with a different perspective it would be much appreciated. Please let me know if I need to clarify or explain further. I hope I've made myself clear. Thanks, T
Paid Search Marketing | | TZ19820 -
304 "If Modified Header" Triggers Error in Google Ads?
We have a client who is launch some Google Ads campaigns, and they recently asked us to fix 304 "Errors" on their website as per this feedback: "When we inspected the website we came across a number of 304 status errors. In order to get the ads running, we will need all of the website domain status codes converted to 200. “ Of course, all of their website pages return a 200 Status, it's just the HTTP headers that additionally clarify with a 304 Response (not an error). Has anyone else ever run into this issue with Google Ads? IMHO it makes no sense to remove this functionality. Google has even recommended in the past to use this it: https://webmasters.googleblog.com/2008/11/date-with-googlebot-part-ii-http-status.html Thanks for any tips or feedback!
Paid Search Marketing | | mirabile0 -
Clients Keep Googling Themselves
Hi, I have a common problem with my clients where they google their own business name or keywords they want to rank for and freak out when they don't show up on the first page of results. The same is true for my paid search clients. Is there a good way I can explain to them how Googleing themselves is not the best way to know if they are performing well? If there is an article out there that explains it that I can share that would be even better.
Paid Search Marketing | | GuardianOwlDigital0 -
301 Redirects and Google Shopping Feeds
I am moving my site from Volusion to Shopify. The domain remains the same but the URL paths are different. With respect to my Google Shopping feed, is it best to send old URLs (with 301 redirects) or to send the new URLs?
Paid Search Marketing | | vgusvg0 -
Google Analytics showing my Adwords campaign bounce rate at 0%
I am relatively new to Adwords, and I can't figure out why the Adwords section of Analytics is showing all my site visitors at 0% bounce rate. Does that mean the account connection is not done right? Obviously Google ads are not a 0% bounce rate. If I can't get that to work, does anyone know how Google ads appear in Traffic? Is it Direct or Referral? I'm sure there's some simple answer I'm just not aware of, I would appreciate anyone's help. Thanks!
Paid Search Marketing | | Crystalline_150 -
Paid Search Visits Not Showing Up in Google Analytics
Hey all, Just took over SEM for my company, and noticed a bit of a problem with GA. Whereas Adwords has registered 141 clicks on paid campaigns that go to the site, GA has tracked only 5 vists in that time. Two things of note: The GA account was not linked to the Adwords account until today, and also, auto-tagging was not turned on. I understand these two things are important to having proper GA tracking, but I just want to make sure that there aren't any other things I should check right now to make sure I start to see tracked paid visits again. Is there anything else I should try? Cheers.
Paid Search Marketing | | danny.wood0 -
Google Analytics CPC and PPC not Matching
Hi Why do our CPC in Google Analytic not match our PPC in Adword, surely they should be identical? We have Auto-tagging switched on and data in our history is wrong so it is not a timing issue. Thanks
Paid Search Marketing | | Studio330 -
Increasing Google Ad spend - is it worth it
Hi We are currently spending approx £500 pcm on google ad words however if I increased this spend to £4000 pcm what kind of results would this achieve? For example would it just be more visits per day as the budget is larger? Also what is the best way to track the success of an adwords campaign - the ultimate goal of the campaign would be to generate a lead whether this be a phone call, email or using our book an appointment form. Our service covers a geographical area (Scotland) and for organic search we are doing well 1st pages listings for searches such as pvc doors edinburgh etc so I am unsure whether it's worth increasing my PPC spend or put more resource into SEO, or even Facebook ads?
Paid Search Marketing | | ocelot0