Do you have it selected to notify you in your controls?
Under email settings check to see you you have checked the box next to:
Send a confirmation email when I receive a new private message
Enabling this option will send an email confirmation of any new private messages sent to you.