annotate web/robots.txt @ 832:d5688822c51d

Preface, now with actual text
author Bryan O'Sullivan <bos@serpentine.com>
date Thu, 07 May 2009 22:32:55 -0700
parents ad304b606163
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
673
ad304b606163 Initial cut at web comment system import
Bryan O'Sullivan <bos@serpentine.com>
parents:
diff changeset
1 User-agent: *
ad304b606163 Initial cut at web comment system import
Bryan O'Sullivan <bos@serpentine.com>
parents:
diff changeset
2 Disallow: /feeds/