In Webmaster Hangout, John Mueller answered a question about how to stop Google from scanning and indexing the staging server.

A staging server, or staging site, is a section of a server or website that is used to test a new version of a website.

If a publisher is testing a new web design, they can create a subdomain and test the new website design there.

Traditionally, the most common way to block Google from indexing a staged site was to create robots.a txt file that keeps Google from scanning the staging site.

Google’s John Mueller offered a better solution.

John Mueller responded that the best way to stop Google from scanning and indexing the staging site is to block web pages with authentication.

Here’s how John Mueller answered the question:

“There are several ways … people do this in several ways. I think the important part is that you don’t reference it. Because if we don’t find it, we can’t crawl through it. But sometimes it still happens. “

Mueller’s comment is a reference to the use of Robots.txt to prevent crawling of web pages. If Google finds a link to a blocked web page, Google will crawl the URL.

John then recommends the best way to block both scanning and indexing the test server.

“Ideally, what you would like to do is provide some sort of server-side authentication on the server, so that normal users when they get there they will be blocked from being able to see the content; that will include in GoogleBot.

All where you have to prove that you are the right person and you can really look at this content.

I think this is generally the best approach for staging servers …”

John Mueller then stated why staging a site with authentication is the best approach.

“… this is what means that you don’t have to change the normal settings on the site itself, specifically robots.txt, but also noindex meta tags, for example.”

What he means is that with a password protected solution you will eliminate the possibility of making a mistake in your life due to a mistake using noindex meta tags or robots solution.txt.

More effectively use authentication to block Google and others from viewing a staged site.

There are several ways to create a password protected staging site. If you are on a dedicated server, you can use the control panel to create a password-protected pallet (read the online guide for the control panel or ask your web host for help).

If you are on WordPress and on a shared host, you can use an external staging server like WP StageCoach or if you don’t want to pay, you can use a plugin like WP Staging.

WP Stagecoach makes it super easy to stage a site in a password protected environment. When you’re ready to make a website live WP Stagecoach makes it as simple as clicking a button to move it into your live hosting environment.

I have used WP Stagecoach and can personally attest to the ease of use of this platform.

I also used the WP Staging Plugin.

WP Staging offers a premium version that allows you to easily transfer the test version of the site to the live section.

I poor man used the premium version but I used the free version and found it to be a great solution.

If you are confident with WordPress then you can simply use WordPress ‘ native site export feature to export the site theme and styles then import them into a live site. It’s a little more complicated in that you have to read the manual to make sure you’re doing it right.

Of course, before migrating to a site, be sure to create a backup link to your site. UpDraft Plus is my choice for WordPress backup plugin. It’s the only one I’ve ever used because I’ve never had to test any other. I can’t say it’s the best, but it sure works as the best for me in that it’s easy to use.

Returning to John Mueller, I agree with his advice. It’s a good idea to put a site behind a password protected directory or subdomain.

Watch John Mueller’s answer here:

Get our daily newsletter from Seju’s founder Lauren Baker on the latest industry news!

Roger Montti is a search engine marketer with 20 years of experience. I suggest site audit and link building strategies. I’ll be seeing you… (Read the full bio)

Unlimited keyword research for PPC