Search engines look to webmasters to create websites and content with a variety of search engine tools that suit and enhance search engine protocols.
Webmaster definition summary from Wikipedia
A webmaster is a website architect, developer, author, administrator, co-ordinator and responsible for maintaining one or many websites.
This blog I have attempted to simplify this review for the non technical reader about search engine tools and protocols in chapter 8 “Search Engine Tools and Services” from MOZ beginners Guide to SEO.
#1. Search Engine Protocols…
Sitemaps are an important listing of file URL’s that help search engine crawlers view and index content. The use of categories and tags also help crawlers find URLs.
- Extendable Markup Language (XML) makes it easy for search engines to trace the information
- With Really Simple Syndication or Rich Site Summary (RSS)
- When people sign up to an RSS feed they automatically are advised that a new article is available
- Text Files (Txt) is one URL per line up to 50,000 lines and very easy to use.
The webmaster can indicate to search engines which areas or articles they would disallow bots from crawling.
To block all web crawlers from all content use this code User-agent:*Disallow:/
1.3 Meta Robots
You can instruct the bots not to index or follow by using this code in the head section of the HTML document.
<meta name= “ROBOTS” content=”NOINDEX, NOFOLLOW”>
1.4 Rel =”nofollow”
“nofollow” tells search engines not to follow the link using this code.
More information in point 7 of my “Crawlable Link Structures part 4”. More here
1.5 Rel =”Canonical”
Canonicalisation is where you have duplication of content. You can use one of these or instruct the bots as to which article is the authoritative version.
Use one of these
- 301 — redirect to the dominant URL
- Canonical URL tag – A great plugin that can cover this and provide most SEO solutions is WordPress SEO by Yoast in the Advanced section
- or just avoid the duplication of content
This noted in previous point 4 Duplication of content under “Keyword usage dominate Part 5” Here
#2. Search Engine Tools…
All search engines have free tools to assist webmasters improve their search results. There are some small variations between search engines but with Google being the dominate player most search engines tend to follow Google.
In this article I will review three:
2.1 Google Webmaster Tools
Google webmaster tools provide feedback for the below information on your website under the
- Configuration including settings and other related information
- Health of your website such as crawler errors, stats, blocked URL’s and malware
- Traffic such as search queries and links
- Optimisation with the use of Google+ integration especially with social networks.
- Lab reports including speed of your website
2.2 Bing Webmaster Centre
Bing webmaster centre provides similar information and feed back under the following headings
- Configure my site sitemap, URLs, crawl control, links, etc.
- Report and data on keywords, traffic, SEO reports, inbound links and crawl information.
- Diagnostics and tools for keyword research, links, bingbot, validator and SEO analyser.
2.3 MOZ open site explorer.
Although not run by search engines it provides comparable data.
Use this tool https://moz.com/researchtools/ose/ and enter your URL for a free report.
For those who are really serious about indepth SEO MOZ are the standouts.
MOZ is a very respected software as a service company based in Seattle, USA that sells excellent industry leading inbound marketing and marketing analytics software by subscription. More here.
Search Engine Tools Summary
This blog is a review about search engine tools and protocols in chapter 8 “Search Engine Tools and Services” from MOZ beginners Guide to SEO. More here.