customers in site upload files in node stored in sites/default/files. ideally i'd want file hidden world. shocked 1 day find google listing 1 private file in search results.
so can add directory in robots.txt? affect else? @ least search engines not bring files open world!
if add uploads directory robots.txt google skip it.
this how can add stuff robots.txt:
user-agent: * disallow: /folder/ disallow: /folder/file.htm 
Comments
Post a Comment