Indigenous Affairs Minister Nigel Scullion says he isn't fazed by rumours of a cabinet reshuffle putting his job in jeopardy.
Backers of Tony Abbott have pushed for the former prime minister to take the Northern Territory senator's portfolio and re-enter cabinet to heal the rift with Prime Minister Malcolm Turnbull, who deposed him in 2015.
But Minister Scullion, who was visiting Arnhem Land on Thursday, dismissed it as just "politics".
"I focus on the best outcomes for my mob here. Silliness and politics I just don't worry about," he said.
"I'm not very good at politics, so I just play to my strengths. I'm in the business of making life better on country."
He rejected suggestions that Mr Turnbull should follow his predecessor's lead and spend more time in remote indigenous communities.
During his tenure, Mr Abbott said it was only fair the prime minister spent two per cent of the year focusing on a group that makes up three per cent of the nation's population.
But Senator Scullion defended Mr Turnbull's efforts amid numerous responsibilities.
"The boss spends a fair bit of time in indigenous areas, I know he's got a fantastic relationship with the mob at (Sydney's) La Perouse," he said.