The concept of this is fantastic and has SO MUCH potential. The idea of an oblivious, haunted guy fishing up random items from his past is really great. The game just needs more time to grow.
In its current state, the visuals, animations, textures, etc. are very basic. With a bit of fog, a moody sunset sky, and a better water shader, this would make a good impression. As for gameplay, the minigames are okay, they just need fleshing out.
The writing is decent, I can imagine the character speaking in a haunted, dreamlike way.
The music does a good job setting the atmosphere. Again, with more time, I genuinely think this could be something pretty special.
Congrats on your first gamejam!