too much leavening can cause the bread to rise up too much and this will cause it to sink back as it cools. if you are having problems still then you could try making banana muffins instead. it is easier to make sure these are baked through properly (again use a cake tester to check).