Sure I get that but what you're doing could make the chassis give you a serious shock if some current has to be led away using the ground.
The ground is third or fourth layer of protection so you will likely be fine. If something strange, powerwise, happens I would advise you to make sure you...