A delegation of senior Victorian Liberals has reportedly told State Opposition Leader Brad Battin that he should stand aside.