This. You encounter hundreds, if not thousands, of uga fans on a trip to athens. Most of the bad stories involve only a few bad eggs. The best way to avoid altercations is good defense, including:
Avoiding the rowdy bars at night. It sucks, but you are much more likely to get into a fight at one of the college bars, as opposed to if you make reservations at last resort and enjoy a nice dinner the night before.
If you do hit the rowdy bars at night, wear neutral clothes. I'd also recommend the less sport bars, like nowhere, or going to see music (like at 40 watt). The giant bars on the main drag are what you want to avoid like the plague.
Afternoon games you are probably fine.
For night games, and it sounds weird, I would recommend avoiding the tailgating scene altogether. The closer to gametime you show up to the stadium, the lesser chance to find one of the bad eggs.
Also avoid going nuts unless in a heavy GT section. Even something as simple as standing up to clap a big play will get ice, peanuts, ketchup, etc. hurled in your direction.
The advice about grad schools is great if you do choose to hang out. I'd recommend the areas around the law school. Most uga lawyers aren't going to risk getting disbarred to fight a tech fan - and most of them aren't terrible people anyways.
Same drill after the game - more chill bars off the beaten path, not the bars the drunkos can get to by stumbling out of the stadium.