Dismantling an overhead water tank involves draining out all the water, breaking the tank into smaller pieces using tools like hammers and saws, and then safely removing all the pieces. This process should be done carefully to prevent accidents.