Akeeba Admin Core
I had a problem that made it so Joomla would not upgrade itself. Akeeba Admin Core did the upgrade.
Akeeba Backup Core
A simple tool to backup and restore Joomla when you need to.
JCE Content Editor
Replace the normal text editor
For minor releases usually just upload over the old dir.