I'm not sure what the OP means by "giving a pass."
I don't think there are any circumstances – injuries, scheme-changes, anything – that make losing at home to an FBS school 'understandable' or 'reasonable.' Similarly, when I think about the occasional atrocious teams that Grant field has hosted in the past 60 years (and sadly there's been some really bad teams on the Flats in those years) not a single one of them couldn't even score a FG in garbage time. That's not 'understandable' or 'reasonable.' If we'd lost all our games like the UVA loss, or heck like the UNC loss, or heck maybe even like the Clemson loss, I would be less upset about our record. Because it's not so much the record as how badly we've played achieving it, in those two games in particular.
All that said, I certainly am not convinced CGC is a bad coach, or has bad assistants or whatever, nor that he and his regime aren't right for Tech. It's not like I want the guy fired, for heaven's sake. I like him personally, I respect his media-savvy 'au courant' approach, and I think it's amazing and refreshing to see him refusing to accept GT's 'limitations' at face value. With his recruiting prowess, he has a chance to really level the playing field, athlete-wise, in a way we haven't seen at Tech in a few decades at least. He could turn into a truly great coach if he's able to build a real player-focused 'family' culture like Dabo has done.
So where does that leave me? Am I giving him a pass or not? You tell me. The Citadel and Va Tech games are just data points (really low ones) as I build an overall impression of the guy. There are some much better data points, too. Time will tell which are the outliers and which the trend. But I'm not afraid to express my frustration at how low some of the data points are.