HeadlinesBriefing favicon HeadlinesBriefing.com

Remembering the pre‑Google web, when search was an experiment

Ars Technica •
×

In the mid‑’90s the web was exploding, but finding value felt like negotiating with a proto‑search engine. Sites such as Alta Vista, Lycos, Excite, Hot Bot, and Ask Jeeves promised to tame the chaos, each with quirks and charms. The real story is that early engines reflected a different Internet—directories mattered, crawling was an art, ranking was fragile, and search had not yet hardened into a single dominant interface.

Users relied on Yahoo‑style directories, bookmarks, newsgroups, and email signatures because the web was small enough for human organization to compete with machine indexing. Usenet, conceived in 1979, offered topic‑based newsgroups and a culture of distributed discussion that made online information feel social before major web engines arrived. Webrings, a block of code linking to related sites, let niche communities thrive, often managed by upstanding curators.

When the web grew, human curation couldn’t scale. Crawlers and indexes appeared: Alta Vista combined a fast crawler with scalable indexing, handling millions of HTTP requests per day. It made search feel less like browsing a catalog and more like querying a giant machine, setting the expectation that search should be immediate.

Yet results were rough, and searching required patience and genuine skill, a stark contrast to today’s Google‑style UI.