I can't get images with premultiplied alpha to display correctly in Krita, can't find any options for it at all.
How do I tell Krita to use it?

Krita cannot work with premultiplied alpha, so if you're using exr, it has to be converted back and forth, which isn't ideal.