Stopping search engines from indexing your site or one of your pages is simple with this short code-snippet:
Following W3C standards make sure you place the above into the <head> of your page document for the tag to be read.
If you only want to block Google but allow other search engines to index your page you can use this snippet instead:
<meta name="googlebot" content="noindex">
If you don't want to, or don't have the ability to change the meta tags in your code, you can also block individual pages using a robots.txt file. Robots.txt should be placed in the root of your site for robots to notice it (e.g. inside public_html).
You can also block an entire directory by adding a forward slash to the end like so:
To block images specifically from 'Google Images' use the following:
To block all images:
It's also possible to blog files by their type using:
Some search engines (including Google) also support pattern matching. This allows you to ignore a specific range of files or pages, for example:
This will ignore any folder paths that start with 'ignore'.