# This robots file disallows all search robots from indexing the aidbase site. # A particular problem was noted with the MSN bot which seems to start indexing # the entire web through aidbase. # The file must live in the site root - i.e. with index.html. # See example at www.aidbase.org/robots.txt User-agent: * Disallow: /loband/page Disallow: /loband/filter