Get You Free Audit From An Expert! Contact us. No cost. No obligation.

We’re ready to listen…

* Indicates a required field

Complete the form below or call us on US (Toll Free) +1-888-322-7617 USA: 646-688-5525 | UK: +44-161-870-6437 | AU: +61-261-452-356 | India: +91-120-4271001

Complete the form below or call us on US (Toll Free) +1-888-322-7617 USA: 646-688-5525 | UK: +44-161-870-6437 | AU: +61-261-452-356 | India: +91 (0)1204338720

X-Robots-Tag in HTTP Header

January 7, 2014

Robots Meta tag is implemented to control the crawling and indexing of that particular page. But in some cases, the implementation of a Robots Meta tag is not possible. The reasons can be

  • a) The file type is non-HTML. Meta Robots tag can’t be implemented .doc, .pdf, .xls, video or audio files.
  • b) where the editing of the code or content of an HTML file is not possible.
  • c) Sites with large amounts of changing content, where updating individual files is too hard or expensive.

In such a case, X-Robots-Tag is the solution. An X-Robots-Tag is an element in HTTP header which can contain same values as the Robots META tags.
This can be done using by sever-side tools so that this information is generated by web server.
Given below is the example to avoid indexing .doc files through .htaccess.

Header set X-Robots-Tag “NOINDEX, NOFOLLOW”

Want to boost your online visibility? Contact SEO India Company, Profit By Search, Today!

About Zuhair

Skills that makes the web alive, Working as Creative Design Head at ONS Interactive Solutions. 20+ UI Designers and Developers are supporting to make word class work with their dedication and their expertise. Zuhair himself is the Creative Visualizer, Conversion Expert and Able to implement the project with the required criteria


US (Toll Free) +1-888-322-7617, UK +44-161-870-6437, AU +61-261-452-356, IN +91 (0)1204338720

US (Toll Free) +1-888-322-7617, UK +44-161-870-6437, AU +61-261-452-356, IN +91-95601-58367

India Address: Plot No. 165, NSEZ, Noida (U.P.), India – 201305

USA Address: 340 S Lemon Ave, Suite #1831 Walnut, CA 91789, USA

  • captcha