I have now collected the certificate and try to export this from
Internet Explorer.
At the windows where I can choose to export the private key, this is
not possible - the option is greyed out - and the message says that the
private key is not marked as exportable.

How to solve this ?