To be more exact it will only alert you the moment you receive a message from a contact and you don't have a chat window open yet with that contact.
So this is different than some people might interpret "started a new conversation". Aka: it does not alert when a new conversation window is started, it does not alert when the contacts starts to type a message; it only alerts when the message is recieved by you.
/ 
