London, June 14 (ANI): British Prime Minister Gordon Brown may have to face more difficulties in the days to come, as one of his closest allies Ed Balls, has said that he could ask Brown to step down.

It has been revealed that Balls, who is currently the country's Schools Secretary, stunned Labour MPs by saying he is prepared to get rid of Brown at Labour's annual conference scheduled to be held in September.

Balls, who is apparently Brown's most trusted man, said that unless the party showed signs of recovery in the coming polls, he would ask the PM to consider quitting.

Senior party leaders believe Ball's statement is primarily in response to the fears within the party that it could be heading for a void if Brown leads in the general elections, The News of the World reports.

"The people around Brown like Balls are incredibly loyal to him. But their first loyalty is to the Labour Party," said a senior party leader.

"We know we are going to lose the next election. But there is a hell of a difference between losing and ending up with just 100 MPs. That is the way we are heading. And it is dawning on even those around Gordon," he added.

t has also been disclosed that Balls had a heated telephonic debate with Foreign Secretary, David Miliband over the deteriorating situation.

Balls reportedly told Miliband that the PM had 'lost touch' and needed 'urgent correction.'

Meanwhile, Britain's First Secretary of States, Peter Mandelson, who saved Brown during this month's coup attempt, has admitted that there would be another attempt to oust Brown at the party conference in Brighton.

This certainly increases concerns for Brown, and clearly suggests that he is still not safe. So far 11 government ministers have resigned , including five of Cabinet rank. (ANI)