Most web directories make use of meta tags as well as keywords to search for sites, where as search engines utilize intricate algorithms that take into account much more than meta tags. Go here: http://www.megawebexpress.com/Links/links.htm for more information.
Vrael shouted: I almost had a heart attack just thinking about calculating all the offsets it would take to do that kind of stuff
With the modern EUD editors, I don't think they're calculating nearly as many offsets as you might imagine. Still some fancy ass work that I'm sure took a ton of effort