It is normal for the power button to be a little loose.  It's part of a thermally-activated switch mechanism.  It's ability to move freely is key to that.  Once depressed, it says on until the brew is complete (water runs out).