@Brian Lenz Thanks so much for all your help.
But what if I want to change the IDP I set up earlier. I can no longer access the Settings page for me to upload another metadata xml.
I set up single sign on earlier however, I got an error after logging to the idp, please see screenshot below:
So I'm exploring other options and I have another metadata xml that I would like to upload but I couldn't get to the page because of the error above. Appreciate all your patience and help in all these.