I have seen it suggested that even Whisenhunt turned us down flat, actually, and only talked to TStan as a courtesy. It makes sense that up and coming coaches wouldn't want to go to a place to try and flip a roster, knowing that fans have come to expect bowl games at a minimum. Collins can take the hits because he has this unshakeable faith in the power of positive thinking.
I do think we will be in a much better position in a year or two, if a change needs to be made. We'll have a talented roster and an improved recruiting reputation. People don't realize how far we had fallen in industry circles. The duct taped 7 win seasons covered it up.