Exclusive: Letter signed by figures on right and left of party says UK should follow Australia’s example by enacting ban