Leadership speculation continues to surround Labor, despite Kevin Rudd ruling out a challenge to Julia Gillard.