Its mostly the whole protag being an asshole, having a bit of an ego, the meta elements felt like they were horned in. I'd argue the goddess can use it but the protag? His personality oozes chuunibyou syndrome. A bit of an unlikeable trait. The whole 4th wall breaking moments just loses my immersion. The reading is fine, I'm a bit patient but if I'm bored I tend to just speedread through the dialogue and just gleam a bit without understanding fully what you're trying to convey.
This series felt like Konosuba but without the 4th wall jokes being in your face. And the comedic timing is better in that show. Despite the differences, the comedic elements somewhat match to a degree.
Comedy is subjective though, this might not be for me. Someone else might like it more.