A “Spider, Bot, Robot, or Crawler” is an automated program or script operated by a search engine that surfs the Web just like you would. As it visits each Web site, it records or indexes it, all the words on each site and notes each link to other sites. Read More