SParks are caused by the sudden rush of power to charge the capacitors in the controler. Some tollerate this better than others. at 36 volts, ignore it. at 72 volts, It might cause the caps to blow out eventualy, maybe. It happens. The more imediate problem is the slow eroding of your connector. each spark is burning a pit in your contact, and will eventualy ruin the connector.
The solution is called a precharg resistor. basicly its a resistor that allows the capacitors to charge up slower, say, a half a second, then lets you have full power. Plenty of ways to make this work. the simplist is to have 2 positive conectors to the battery. the first has a 100 ohm 1/4 wat resistor inline. the second is your regular connector. plug the resistor's line in first, then the regular line.
Or you could use an inline On/off switch on the main power wire, with a 100 ohm resistor shorting out the 2 poles of the switch. when "off" the power goes through the resistor. So you plug in the battery with the switch "off" then turn it on. No spark, no power surge. You just have to remember that power is always "on" with that switch, just not full power.