Hi Manukahn,
There can be multiple issues if you don't configure the IDP or RP correctly. How did you configure the identity provider and the relying party?
Now, most of the issues are due to an incorrectly configured realm in your RP. What are you using as realm? Verify if it matches the URL of your application.
Sandrino
Sandrino Di Mattia | Twitter: http://twitter.com/sandrinodm | Azure Blog: http://fabriccontroller.net/blog | Blog: http://sandrinodimattia.net/blog