62f43c04e9
Instructions are given in INSTALL and README.robots about adding a robots.txt file to the opac to prevent search engines from indexing Koha. Signed-off-by: Galen Charlton <gmcharlt@gmail.com>
18 lines
673 B
Text
18 lines
673 B
Text
The robots.txt file.
|
|
|
|
Search engines, when looking for sites to show in search results, will first
|
|
look for the file /robots.txt. If this file is found and has lines that apply
|
|
to them they will do as instructed. A very basic robots.txt follow as an
|
|
example:
|
|
|
|
# go away
|
|
User-agent: *
|
|
Disallow: /
|
|
|
|
This tells every search engine that cares (User-agent: *) to not index the site
|
|
(Disallow everything past /).
|
|
|
|
If you have installed Koha to /usr/local/koha3 then this file would be placed
|
|
in the directory /usr/local/koha3/opac/htdocs/. This should prevent search
|
|
engines from browsing every biblio record, and every view of each record, on
|
|
your Koha install periodically.
|