Low Battery warning when I plus my Edge 540, and refusing to charge

I bought this GPS 8 month ago and had a really good experience with it until now.

When plugged in, the GPS stays stuck at 1%, and when I turn it on I get spammed with Low Battery warnings (1 per second).

Does anyone experience similar issues ?