I found the solution, the scope was missing in the doc : https://github.com/hwi/HWIOAuthBundle/blob/master/Resources/doc/resource_owners/windows_live.md
I had to add it :
windows_live:
type: windows_live
client_id: X
client_secret: X
scope: wl.signin