Problem is that even those that have never setup an account with Facebook still have a profile that Facebook built on their behalf. If you are in any photos that friends/family/coworkers uploaded and if even one person named you in the photo, you are now known by fb and anyone who uses that data.