Martijn Koster
Quick Facts
Biography
Martijn Koster (born ca 1970) is a Dutch software engineer noted for his pioneering work on Internet searching.
Koster created Aliweb, the Internet's first Search Engine, which was announced in November 1993 while working at Nexor and presented in May 1994 at the First International Conference on the World Wide Web. Koster also developed Achiplex, a search engine for FTP sites that pre-dates the Web, and CUSI, a simple tool that allowed you to search different search engines in quick succession, useful in the early days of search when services provided varying results.
Koster, also created the Robots Exclusion Standard, used to prevent cooperating web crawlers and other web robots from accessing all or part of a website which is otherwise publicly viewable.