Try using the --verbose option to see what actually happens.
git might need to push a lot of data, even if you only made small changes.
Have a look at git-gc.
It cleans up your local repository and might speed things up.
Backup strongly advised befor use!