The alerts will only appear if there's unread e-mail in the inbox.
There is a way to double-check Plus! is polling the account: set the auto-check delay to something short, like 1 minute, and use a network traffic monitor to look for outgoing connections connecting to a remote server's port 110.
If that sounds a little complicated, then just send yourself an e-mail