The gloves are off

First home game of the ice hockey season today, a 'friendly' against the Belfast Giants. It wasn't very friendly, and this full on scrap broke out. Once players take their gloves off, then the full penalty ensues. I thought this was where the phrase 'the gloves are off' had derived from, but the Internet tells me it's a boxing idiom.