Yes, I have tried this and I cannot see the those keys in Azure Key Vault. I am checking this internally if this is by design and let you know of my findings.
Also, do you want to access Azure Key Vault from PowerBI. If so, it is not possible yet and I can see the below feedback in PowerBI feedback
forum as well.