Also, the Facebook chat is new, and you might need to enable it first in your Windows Live profile before it becomes available.
Go to
http://profile.live.com/Services/Add.aspx?appid=1140906031 and check if "Chat with my Facebook friends in Messenger" is enabled (first of the three options under the first paragraph - if you don't have that option it isn't available to your local yet).