The index of crawler based search engines (like AltaVista, Infoseek, Inktomi etc.) are built by sending out crawlers (robot programs) that capture text and bring it back. No human filtering or judgement is involved. What they see is what you'll get.