Tetra Submersible Heaters?

2-15 Gallon. Are they supposed to be on at all time? I jus got one for my tank. And the first time i plugged it in the tank it got warm immediatly but now the water is cold. is it supposed to do this?