Your feedback proved helpful !
I added a scene to cache the shaders before the game and tested it, It seems that the freezing is reduced to a significant extent. I added some more platforming areas and made the boss fight tougher. If you'd like, you can give it another try. Thank you so much for letting me know about shader caching.