What window size will you need for your game?
That is really quite up to you. Given that pygame(-ce) is most commonly used with pixel art, the base resolution is typically quite low. I personally like to use either 640 by 360 or 320 by 180 pixels (then I would scale it all up using the SCALED flag or similar). But again, completely up to you, just see what works best for your game and art.