Well, eveything is in the title. When playing emperor, I'd be very convinient to pause when pressing the space bar.

Yes it'll be in the next update :)

Also, if you press 's' it will advance the time 1/10 of a millennia and then pause automatically (think "Step")

This is great ! Will we have a similar feature on android ?

There will be a button for stepping so Android users can tap it.