The rumbling sound is usually an indication that you have sediment that has built up on the bottom of your water heater. The sound is water trapped in the sediment when it starts to boil. A water heater making that type of sound is not operating at peak capacity, which can cost you money.