What's the Best Conference in College Football?

Date: Friday, January 12, 2007
To: Readers
From: Geoff, Editor – The Hoover Street Rag
Subject: Relative Strength of BCS Conferences

Contents
1.  Foreword
2.  Summary
3.  Discussion
3.1 Methodology
3.2 Fifteen-Year Results
3.3 Ten-Year Results
3.4 Five-Year Results
3.5 Other Five-Year Spans
4.  Conclusions


1.  Foreword
On Saturday, December 2 of last year, as people debated whether Florida or Michigan should be invited to face Ohio State in the BCS National Championship game, the perceived historical strength of the SEC and weakness of the Big Ten was taken as a given by some commentators and voters.  This was not a new statement, and I'd heard it so many times before that I almost believed it.  But as a lifelong fan of a Big Ten team, it irked me and I wanted to see for myself if it was true, or just another myth.  To answer my own question, I've prepared a comparison of the BCS conferences over the past 15 seasons (and shorter intervals) and here I'll share with you my results.


2.  Summary
While the SEC has probably been the toughest conference in college football over the past 15 seasons (relying heavily on its sterling bowl record over that period), in the past 5 seasons both the Big Ten and the ACC have been better.  The ACC's 0.5416 winning percentage bests both the Big Ten's 0.5214 and the SEC's 0.5047 over that period.


3.  Discussion

3.1  Methodology
Using the marvelous treasure trove of data available at jhowell.net and (since they weren't available there yet) the BCS conferences' own results for 2006, I stripped out the last 15 seasons for every team that currently plays in a BCS conference.  I pared the data down further by then extracting teams' records against non-conference opponents from other BCS conferences (e.g. Florida State's record against the Big East, the Pac-10, etc.) and removing data against intra-conference teams and non-BCS foes/cannon fodder.  I've also included Notre Dame in all of these records, since they've consistently been a good enough team to play in a BCS conference.

Teams are treated as if the conference they're currently in has always been their conference (so Louisville has always been a Big East team and Texas has always been in the Big XII).  The purpose here is to find the strength of each conference based on the teams it presently consists of, not its historical roster.

The problem comes in with the Big East teams that jumped ship for the ACC.  The way I've treated all other teams, Miami, Boston College, and Virginia Tech's conference games against other Big East opponents would now count as ACC victories over the Big East.  However, the sheer number of games they'd bring with them against the Big East would seriously distort the results.  Those three teams played 156 games against Big East opponents, while the rest of the ACC combined only played 263 games against all the other BCS conferences over that period.

I thought about just throwing out those games, but who's to say they wouldn't have at least played some portion of those games anyway?  In the end, I assumed each of the teams would have played one game per season against a Big East team, and used that as a conversion factor.  It's ugly, in that you end up with teams getting partial wins and losses, but I think it's fairer than giving them credit for everything or nothing.

I've also taken bowl games into account for this analysis.  Even if some teams seem to rarely show up for their bowl appearances, you're at least supposed to play to win the games, and they can be a very significant portion of a conference's games against other BCS opponents.


3.2  Fifteen-Year Results
Fifteen seasons of non-conference data have been distilled into the following table.

Table 1:  1992-2006
  Total Regular Season Bowl
Conf.WLTPctWLTPctWLPct
Big East90.8180.230.333278.8165.230.321012150.4444
Big XII13414610.47779710010.491137460.4458
Pac-1012212930.48329310030.478129290.5000
Big Ten19517330.527715312730.543542460.4773
ACC197.2167.830.5381155.2131.830.538042360.5385
SEC14811710.5574937710.545555400.5789

Over the past 15 seasons, the SEC has been ahead of everyone else.  They've possessed both excellent regular-season and postseason records, although the regular-season mark is barely ahead of the Big Ten.

Once could also make the argument that the Pac-10 has been underrated through this period.  There's a considerable drop-off between the top three conferences and the Pac-10/Big XII duo, but I would argue that the Big XII has gotten undeserved respect over that timeframe and the Pac-10 has been undervalued.  They possess nearly identical regular-season records over that span, and the Pac-10 has been much better in bowl season.

Then, there's the Big East.   It's really no surprise that their winning percentage has been this low.  Over this stretch, teams playing in that conference not called Miami and Virginia Tech have gotten exactly the respect they deserve.  The Big East teams now on the rise hadn't yet really started that rise back in the early to mid-nineties.

One more thing I'd like to point out when looking at this data is to take notice of the number of regular season games played out of conference.  Distinctly lagging is the SEC, which supports another piece of conventional wisdom.  The SEC really doesn't (or at least didn't) play anybody.  The Big Ten played 283 regular-season non-conference games against BCS opponents.  That's an average of 1.72 games per team per season.  The SEC played 171, or 0.95 games per team per season.  Whereas most Big Ten teams took on 2 BCS opponents a year, the SEC filled that slot with some scrubs from the Sun Belt.  The Big XII also mostly stayed at home, though not to the SEC's extent.


3.3  Ten-Year Results
Looking at the 11-season and 10-season results, a turning point appears.  In Table 2, the ACC has improved slightly and claimed the overall lead for toughest conference, but only by a slim margin over the SEC.  The Big Ten itself isn't far behind at all.  A swing of only two games in the SEC puts them ahead.  In Table 3, that swing manifests itself.  The SEC's 14-3 1996 season is no longer counted and the Big Ten drops its 19-14 season.  Both conferences had above-average seasons, but the SEC's was more of an outlier.  The ACC outperforms both and slightly increases its overall lead.

Table 2:  1996-2006
  Total Regular Season Bowl
Conf.WLPctWLPctWLPct
Big East62.9121.60.340953.9108.60.33179130.4091
Big XII921040.469463690.477329350.4531
Pac-1094940.500071730.493123210.5227
Big Ten1391220.5326105860.549734360.4857
SEC110940.539266630.511644310.5867
ACC138.6116.90.5425109.691.90.543929250.5370

Table 3:  1997-2006
  Total Regular Season Bowl
Conf.WLPctWLPctWLPct
Big East54.3100.30.351145.388.30.33909120.4286
Big XII84960.466757630.475027330.4500
Pac-1089840.514567650.507622190.5366
SEC100910.523660600.500040310.5634
Big Ten1231110.525692780.541231330.4844
ACC121.3100.30.547493.378.30.543728220.5600

In other conferences, the Big East has made significant improvements and its winning percentage improves continually as we shrink the timeframe we look at.  The Pac-10 ducks over the .500 barrier briefly, while the Big XII has slipped just slightly.


3.4  Five-Year Results
I consider the five-year data to probably be the most relevant to the argument of which conference is strongest today.  The Big East isn't punished so badly for its programs that are just now making themselves into national contenders, and the established conferences don't get to coast on their legacies.  At the same time, there's enough data so that small sample sizes aren't a big problem.

Table 4:  2002-2006
  Total Regular Season Bowl
Conf.WLPctWLPctWLPct
Big East34.855.20.386329.848.20.3816570.4167
Big XII44470.483530300.500014170.4516
Pac-1045470.489133370.471412100.5455
SEC54530.504735380.479519150.5588
Big Ten61560.521445380.542216180.4706
ACC68.257.80.541652.246.80.527616110.5926

The data show that he ACC has been the toughest conference over the past five years.  I've checked, and even if you throw out all the former Big East vs. Big East matchups, that's still the case, though it does drop to a sub-.500 conference in the regular season.  Their unchallenged record in bowl games pulls up their overall winning percentage enough to hold on to the top spot. That they maintained their lead despite how hideous the conference looked this past season shows how strong a conference it's been over the whole of the past five years.

The Big Ten is the clear winner here when it comes to regular season winning percentage, but the usual swoon in bowl season holds their numbers down.  The surprise is that the Big XII performed so well in the regular season over this stretch.  In the other time frames examined here, it's been a sub-.500 conference.  Their bowl winning percentage still hasn't improved, however, so the Pac-10 remains the better overall conference.

One reason that the bowl record has such an impact is that the Big XII as a whole barely scheduled any BCS opponents.  Each team played an average of 1.00 games against non-conference BCS opponents per season.  Over the same stretch, Big Ten teams played 1.51 of those games per team per season, showing the decline of tougher scheduling in the north.  On the other hand, SEC teams have improved to 1.21 games per team per season, bucking their historical trend.


3.5  Other Five-Year Spans
Breaking down the data in a different way, we can see that the conventional wisdom comes from what was once true:  The SEC was the dominant conference, but they never played a decent non-conference opponent.  If we examine the five-year results from 1992-1996 and 1997-2001, we should be able to illuminate some of the larger trends.

Table 5:  1992-1996
  Total Regular Season Bowl
Conf.WLTPctWLTPctWLPct
Big East36.580.030.309733.577.030.2995330.4444
Pac-10334530.4151263530.41607100.4118
Big XII505010.4975403710.516110130.4348
ACC76.067.530.523862.053.530.529514140.5385
Big Ten726230.5314614930.547111130.4583
SEC482610.6443331710.65351590.6250

It shows up clearly here.  The SEC was dominant in the early and mid-'90's, but they never bothered to play anyone in the regular season.  The Big Ten played more than double the number of equivalent games over that stretch, playing 2.05 per team per season, while the SEC only scheduled 0.85 per team per season.  Alabama and Mississippi State each only played two games against non-conference BCS opposition.  Arkansas, Auburn, and Ole Miss didn't play any. Any!

At the same time, they won a huge number of the games that they did play.  A 0.6443 winning percentage across the conference is an impressive number that no one else can touch.  They absolutely deserved to be known as the best conference in football.

Let's look at the next five years after that.

Table 6:  1997-2002
  Total Regular Season Bowl
Conf.WLPctWLPctWLPct
Big East19.545.00.302215.540.00.2791450.4444
Big XII40490.449427330.450013160.4483
Big Ten62550.529947400.540215150.5000
Pac-1044370.543234280.54841090.5263
SEC46380.547625220.531921160.5676
ACC53.042.50.555141.031.50.565712110.5217

Of course, my first impression is that the late '90's were not kind to the Big Ten, but if you look closer you can see that's not really the case.  The bowl winning percentage crept all the way to .500, while the overall dropped by less than 0.15%.  It's that the ACC and the Pac-10 came on like a house afire, while the SEC dropped back to Earth.  I'm as shocked as anyone to see the Pac-10 riding so high, especially before USC's return to the college football elite, but there it is.  Mid-level Pac-10 teams managed to win just a few more games than they lost, and there the numbers are.

Table 7:  2002-2006 (Table 4, reprinted)
  Total Regular Season Bowl
Conf.WLPctWLPctWLPct
Big East34.855.20.386329.848.20.3816570.4167
Big XII44470.483530300.500014170.4516
Pac-1045470.489133370.471412100.5455
SEC54530.504735380.479519150.5588
Big Ten61560.521445380.542216180.4706
ACC68.257.80.541652.246.80.527616110.5926

Taking a look once more at the most recent five years throws a few things into even starker relief.  Number one on that list is that the Big East has gotten much, much better very quickly.  To improve your conference-wide winning percentage by over 10% in only five years is tremendously impressive.  They shouldn't be spoken of in the same breath as the power conferences just yet, but they're certainly not the doormats they used to be.

As USC has gotten better, the rest of the Pac-10 has actually gotten worse.  They're still underrated, but the conference was actually healthier when its premiere member was still struggling.

The Big XII has gone the other way.  They're still the fifth-place conference, and still overrated, but they're less fraudulent than they were in the late '90's.  Led by the resurgence at Texas and Oklahoma, they've been a better overall conference.


4.  Conclusions
At the beginning of 1997, the SEC was coming off of an impressive five year run, crushing, killing, and destroying all before them.  Their impeccable regular season record was built around playing very few non-conference games against the future BCS conferences, and playing 60% of the ones they did schedule on their home fields.  Ten years later, this situation is still accepted by some people as the truth, but things have changed.  The ACC is the best all-around conference, the Big Ten is the best in the regular season, and their margins are both much smaller than the SEC's was.  The Big East in the past five years has made up a lot of ground between "functional bye" and "contender", even if they aren't really there yet.

Finally, I'd like to again note the way scheduling has changed.  The SEC's non-conference slate used to be a fraud, apart from a few rivalry games.  They're still well behind some of the other conferences, but they play over 40% more BCS competition in non-conference play than they used to (1.21 vs. 0.85 g/p/s).  The Big Ten has slid the other way.  On average, half of its schools have dropped one of their non-conference games against a BCS school (down to 1.51 g/p/s from 2.05).  The Big XII has taken over as the conference with the weakest non-conference slate.  Each school plays about one non-conference game a year against competition that isn't from Directional State.

With the advent of the permanent 12-game regular season, I'd really hope to see this change.  The Pac-10 plays nine intra-conference games, so they're exempt, but the other schools on this list should take it as an opportunity to play at least two of their non-conference games against quality opposition.  Even if that means we see a lot more Ohio State-Baylor and USC-Indiana games, it's better than the sham that is filling your out-of-conference schedule with Eastern Michigan, Florida International, and Nicholls State.  Yeah, I'm looking at you, Wisconsin.  And you too, Clemson and Alabama.  Don't think I don't see you over there, hiding behind Louisiana-Monroe and Temple.  Wusses.

<-- Back to the HSR