When did Ricky Ponting almost lost captaincy and Why?

Question

When did Ricky Ponting almost lost captaincy and Why? There is one time he was almost pulled; lets see if you can answer this but looking at what you have done so far, you sure know your cricket.

Answer 1

Certainly Ponting's captaincy came under fire after Australia's Ashes loss in 2009, but that was more from the outside, I think.

He was the first Australian captain in more than 100 years to lose two Ashes series in England.

Answer 2

A lot of people suggested that he should quit after losing the Ashes in England for the second time last summer

I'm fairly sure that no Aussie captain has had to hand over the Ashes twice