I decided to get serious and went to a 40 grit belt sander material. Works a treat and hardly wears. Also gives great tire traction and as long as the drive doesn't slip, causes no major wear on the tire.
It is quite thick and stiff though. Not many of the double sided tapes will cut it and also they tend to add too much diameter to the drive especially with the heavy duty belt sander material. For this the Uglue works a treat. For those who havent used it before, its kind of like double sided tape except it lays down a layer of glue suspended in a gell like material. Its nice and thin and has twice the holding power of double sided tape. Plus its water proof. Its a US product but Jaycar stock it so its easy to get.
Give that a go and problem will be solved.