The idea that you can tell things about a person from their appearance underlies the entire point of dressing up, wearing make-up, and being concerned with our appearance. There are probably some things you might be able to assume from a person’s looks, but it’s still going to be pretty unreliable: you can’t tell someone’s a terrorist because they “look muslim” because “looking muslim” is a vague concept to begin with.
What about people who look like criminals?