Since it's powering a light - though a weak drain - it should discharge.
If there had been no indicator light it should be OK, as circuitry is 1-way.

If unsure, take it out