Unwanted Touching

My manager keeps touching me on my shoulder whenever he walks past. It makes me feel really uncomfortable because I don't like being touched or having my personal space invaded. I want to ask him to stop but don't know how to approach him, especially because he is my manager.