donb
committed
on 22 May 03
Fixed parsing problems with files containing tabs, corrected address of
the web robots database.