I start gnome-keyring-daemon with pam_gnome_keyring.so in /etc/pam.d/xdm but gnome-keyring-daemon does not unlock my ssh key. I start gnome services and have SSH Key Agent (GNOME Keyring: SSH AGENT) ticked in Session and Startup in the xfce4 settings. The ssh key shows up when i try ssh-add -l. When I try to ssh I get "sign_and_send_pubkey: signing failed: agent refused operation". The keyring is unlocked, but not the ssh key.
This seems to be fixed now :-)