It is normal in both the Tory Party and the Labour Party for a leader to remain in post until the leadership contest has taken place.
What would be unusual would be for him to not remain until a new leader is appointed.
However, this being Boris the Menace, he should definitely be booted immediately.
