Well, beginnings are always the hardest. I would say the first 300 hours with Unity and C# are the most challenging. After that, it's still hard because you're facing even more difficult problems, but at that point, you can perform the vast majority of simple tasks on a whim, which feels pretty amazing. Finding a right group of people could be a great starting point to help you motivate yourself. Then just stick to simple stuff and before you know you will be doing harder parts too. Just dont give up if you really feel like doing something could make you feel happy. :)