The Internet is so big nowadays that you pretty much need to have some kind of algorithm. A list of all websites in "the right category" would have way too many items in it most of which would be useless. We live in an attention economy: lots of people want as many people as possible to pay attention to them, but everyone's attention is obviously limited.