by useflyer on 5/17/12, 5:05 PM with 77 comments
by pierrefar on 5/17/12, 6:21 PM
I work at Google helping webmasters like this.
As far as I can tell, there are a couple of interacting issues we're seeing on the site that can be causing what you're seeing. It's a bit technical, but it's easy for you to implement a fix.
Firstly, our algorithms recently have been picking one of the following URLs as the canonical URL for the homepage:
http://www.safeshepherd.com/ https://www.safeshepherd.com/ https://safeshepherd.com/
For example, I see that the non-HTTPS pages redirect to the HTTPS pages (e.g. http://www.safeshepherd.com/ to https://www.safeshepherd.com/), but the non-www pages do not redirect to the www pages (both https://www.safeshepherd.com/ and https://safeshepherd.com/ return content). When we find the same content on multiple URLs like this, our algorithms pick one representative URL, and over the past few weeks the choice has been changing. As of 3 days ago, the current choice is https://safeshepherd.com/ .
As it stands, our algorithms are trying to figure out the right canonical URL format, but it's difficult in this kind of situation. You can help by redirecting to your preferred URL format (say https://www.safeshepherd.com/*), and our systems will pick up this signal, and that will be reflected in the search results and reporting in Webmaster Tools.
Secondly, Webmaster Tools treats these as different sites. For example, you would need to verify and check the statistics of both https://www.safeshepherd.com/ and https://safeshepherd.com/ (as well as the HTTP versions) as they're separate sites. It may be that you're checking (say) the stats for http://www.safeshepherd.com/ but if our algos have picked the https://www.safeshepherd.com/ URLs as canonical, the search queries of the former will suddenly be closer to zero but the latter will be a more accurate reflection of the site's traffic.
Hope this helps, Pierre
by TomAnthony on 5/17/12, 6:07 PM
I see a couple of problems with your redirects:
1) http://www.MelonCard.com uses a 302 redirect to the https version. You have inbound links to that domain pointing to the http version, so the 302 negates the following 301.
2) Furthermore, your 301's seem to be implemented incorrectly. It works for me in Safari/Chrome, but if I use curl on the command line, or any crawling software I see an infinite redirect:
www.MelonCard.com/?from=shadow&from=shadow&from=shadow.....
This is likely interrupting Googlebot's crawl too. Certainly worth a fix!
A couple of other bits to note:
1) The redirect in Chrome sends me to:
www.safeshepherd.com/?from=shadow
which Google believes could be different to:
www.safeshepherd.com/
You should add a rel=canonical meta tag to the page to help Google out.
2) Your internal links point to safeshepherd.com without the www., but your MelonCard redirect redirects to the www. version. You should probably make this consistent, and also 301 one version to the other.
This latter points may seem picky, but Google can be troublesome with this.
Hope this helps! :)
by j_s on 5/17/12, 5:28 PM
Clearly, your definition of 'out of the blue' is not the same as mine... good luck figuring out if the problem was on your end or theirs (hitting the front page of HN usually helps).
Edit: clarified transition per comment below
by ericabiz on 5/17/12, 5:35 PM
When I made the switch, I did everything by the book (my background is in SEO) including properly 301 redirecting the .us to the .com and alerting Google in Webmaster Tools.
The site completely disappeared from the Google search results--same symptoms as yours, with site: returning valid info but the site not showing up in search queries at all for the site's name.
This went on for 3 weeks.
Finally, after 22 days, it came back up in the rankings. Where previously it had been #4 for its keyword, it came back at #1.
No explanation from Google or in Webmaster Tools.
(If I may do a brief plug--our rank tracker will help you see if your site is ranking somewhere lower than the first few pages now, and will send you daily email updates so you'll know right away when you come back: http://whooshtraffic.com/rank-tracker/ )
Anyway, I'd have to say that this is par for the course for Google. It will likely come back in a few days or weeks. Time to play the waiting game, and develop some good links from your blog to your main site!
by ApolloRising on 5/17/12, 5:48 PM
------------ Results for https://safeshepherd.com/robots.txt Error at line number 1:
User-Agent: * Capitalization. Field names are case sensitive - the User-agent field should be written with that capitalization Error at line number 2:
Allow: / No User Agent. An Allow line must have a User-agent line before it. As records are delimited by newlines, there cannot be new-lines between the User-agent and Allow lines. Warning at line number 2:
Allow: / Allow is not widely supported. The Allow field was a late addition to the robots.txt standard, and is not currently widely supported by crawlers. You should consider alternative ways of constructing your robots.txt file
Error at line number 3:
Disallow: /login/auth No User Agent. A Disallow line must have a User-agent line before it. As records are delimited by newlines, there cannot be newlines between the User-agent and Disallow lines. Error at line number 4:
Disallow: /users No User Agent. A Disallow line must have a User-agent line before it. As records are delimited by newlines, there cannot be newlines between the User-agent and Disallow lines. Error at line number 5:
Disallow: /signin No User Agent. A Disallow line must have a User-agent line before it. As records are delimited by newlines, there cannot be newlines between the User-agent and Disallow lines. Error at line number 6:
Disallow: /upgrade/submit No User Agent. A Disallow line must have a User-agent line before it. As records are delimited by newlines, there cannot be newlines between the User-agent and Disallow lines.
by epoxyhockey on 5/17/12, 6:04 PM
If I were moving a domain, I would have 301'd http://meloncard.com to safeshepherd.com right out of the gate.
Too add to everyone's anecdotal experiences, I 301'd a domain last week and the new domain only took a couple of days to show up in search. I was a happy customer.
by atticusfinch on 5/17/12, 5:38 PM
by temphn on 5/17/12, 5:34 PM
by AznHisoka on 5/17/12, 5:55 PM
I guess situations like this shows the absurdity and lunacy of people who say things like that.
But I do see your blog as the first result. As for why your main landing page isn't #1, I suggest you just stay calm, and wait a few days. Google has a knack for bouncing results, especially these past few weeks with the Penguin update and all. And if you just recently did the 301-redirect, those things take time to get sorted out. (Since MelonCard was still a relatively young brand, a 301-redirect was harmless, but if you had an old brand/domain, a 301-redirect would be SEO suicide)
You're still in the index. Your blog is ranking for your brand. You haven't been nerfed out of the blue, so stop worrying and be patient.
by unreal37 on 5/17/12, 7:31 PM
by nhebb on 5/17/12, 5:48 PM
by readme on 5/17/12, 9:19 PM
The infographic about beenverified was alarming: (https://www.safeshepherd.com/beenverified) and I have actually tried to get my stuff off of there before and failed.
I'm not even worried about my own information. What I'm worried about is the accuracy of it! How can I trust a third party who doesn't even know me to provide an accurate background check when it references PRIVATE databases that I can't even verify the integrity of? My biggest worry is that some day I will be screwed out of an opportunity because of a company like this that simply provides inaccurate data because they confused me with some other John Doe.
It would be one thing to provide public records as a service, but been verified seriously ticks me off. To think they have the authority to 'verify' people irks me.
Then again, it may be a good thing, because I sure as hell wouldn't want to work with anyone stupid enough to use a service like beenverified.
by nicksergeant on 5/17/12, 6:21 PM
by jrockway on 5/17/12, 5:32 PM
by drone on 5/17/12, 5:44 PM
What gives? We had perfect placement, built not through any SEO, but just a lot of people talking about us - had the proper config and everything, recently had a site overhaul that was handled properly, using webmaster tools, and everything was updated in google indexes within a day.
by robdwoods on 5/18/12, 11:00 PM
by jstanley on 5/17/12, 5:08 PM
by DanBC on 5/17/12, 5:53 PM
by andrewhillman on 5/17/12, 6:30 PM
Google webmaster tools is more or less designed to help google, not you.
by Monotoko on 5/17/12, 6:44 PM
by sevenstar on 5/17/12, 7:27 PM
by SpiderX on 5/17/12, 6:06 PM
by quangv on 5/17/12, 6:31 PM
by keltex on 5/17/12, 5:37 PM
Unlike other updates which attempted to remove "web spam" from the search results by tweaking some of the parameters, this update (according to many in the SEO community) is an active attempt to catch people doing black hat or over SEO optimization. Unfortunately many legit sites have gotten caught in its net.
You can read about it in the WSJ among other places:
http://online.wsj.com/article/SB1000142405270230350550457740...
