The long-time congressman denies the allegations, but allies and supporters are backing away from his campaign.