annotate web/robots.txt @ 689:a2923aa93da9

Fix which files are included in the generated XML.
author Bryan O'Sullivan <bos@serpentine.com>
date Thu, 26 Mar 2009 20:24:44 -0700
parents ad304b606163
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
673
ad304b606163 Initial cut at web comment system import
Bryan O'Sullivan <bos@serpentine.com>
parents:
diff changeset
1 User-agent: *
ad304b606163 Initial cut at web comment system import
Bryan O'Sullivan <bos@serpentine.com>
parents:
diff changeset
2 Disallow: /feeds/