Showing posts with label seo. Show all posts
Showing posts with label seo. Show all posts

Thursday, 29 October 2015

Robots.txt File

A robots.txt file is a text file that instructs web crawler software or search engines whether to visit or register or index a specific webpage or website.


Block all - User-agent: * Disallow: /

Block a specific - User-agent: Googlebot Disallow: /no-google/blocked-page.html

Monday, 26 October 2015

What is a Site Map?

A sitemap is a file where you can list the web pages of your website.

Sitemaps are mainly used to improve the index process of your website by search engines.

Sitemaps are created by hand or by a software.

The simplest way to create a site map is to create an XML file named Web.sitemap that organizes the pages in the site hierarchically.

Site map should be placed at the root of your site hierarchy.

Place a link to your sitemap on the homepage.

Sitemap cab be build online.

https://www.xml-sitemaps.com/
http://www.web-site-map.com/

List of Search Engines OR Web Directory

Web Directory: Web Directory is the list of website.

Search Engine List

Amfibi                           
Alta Vista                       
Arab Bay                     
ASR                               
Alexa Site Claim             
Alexa Add url           
Alibaba                           
Adm city                       
Athens Agor               
AXXA                           
Antya                             
Amidalla
ASR                               
Anazitis                           
Abraham                     
Aport                             
A 1                                 
Amray                     
Add link                       
All States
Anaximander
Ablaze                     
Arena                     
Archiv it                     
About Us
A faq                       
Add url to dir         
AITP Network           
Add url free
Arch wid ABC dir   
Alma                       
Add me                     
Archivd