Replace all batteries at the same time. Do not mix old and new batteries. Use batteries from the same brand, type and expiry date too.
When taking out old batteries, remember to check the compartment for any remaining leakage. This will ensure the new batteries work perfectly.