User-agent: *     ~ All crawlers
allow: /
Disallow:/linkscan
Disallow:/private
htdig:/linkscan