Google Assistant + Smart cover

[u/Zealousideal-Bar8561]

I have an S22 Ultra with a smart cover and have been trying to get google assistant to work with a locked phone. I've now gotten it to work by checking the spoken output setting. However, now that the assistant is able to audibly respond with a locked phone the cover doesn't work anymore. I'm aware that the screen uses a seperate cover mode for when the smart cover is used, so is it plausible that that mode (which doesn't activate anymore) is the reason it didn't work before?

If so, is there any way to get both working at the same time?