Apparently this can cause issues. To be safe, I soldered a simple DC-DC 6-24V to 5V buck converter onto one of the 6V lines (in my case to charge a small LoRa GPS tracker). They are fairly cheap and tiny and already feature a USB-output. It charged - albeit rather slowly. I later removed it...