The Pi-Rate Ratings

September 10, 2013

Questions and Answers

Questions and Answers

Every year, we receive a couple dozen questions from the readers, and we do not always have time to reply to each one.  Since June, and especially since August 29, we have received some excellent questions and comments that will be shown today.  For future reference, drop us a line at: pirate_ratings at live dot com.  When we get enough to answer, we will respond with another one of these segments.

 

1. How do you calculate your ratings?  Is this something anybody could do if they had your equations?

 

Answer: This is a tough one to answer.  Our ratings are not 100% mathematical formulae.  A mathematical formula is used for the base, but the data inputted is not cut and dry.  Whereas many other ratings take the scores of games and the strengths of schedules to make a least squares or least error rating where the scores and schedule strengths fit the best pattern, our ratings try to interpret these scores before running this data.

 

For instance, let us take a game between Oregon and Idaho.  The rating may state that Oregon should win by 77 points.  If they lead 42-0 with six minutes left in the second quarter and then coast to a 66-0 win, while playing the scout team the final quarter, should we really state that the Ducks performed 11 points below par and should be penalized in their next rating?  The Ducks could have won 112-0 without emptying the bench.  We look at how the score was made and not just the score.

 

In another instance, let’s say the final score of a game was 28 to 14.  There are so many different ways to interpret this 14 point win.  It could have been 21-14 with seconds remaining in the game and with the trailing team knocking at the door to tie it up and force overtime.  Let’s say the trailing team threw a pass in the end zone, and the ball went through the receivers’ hands and hit his shoulder pad.  The ball went flying through the air.  Had it flown left, another receiver would have easily caught the ball for a touchdown.  However, it flew right, into the hands of the strong safety, who caught it and ran 106 yards for a touchdown to make the score 28-14 instead of 21-21.  The direction of the deflection cannot be counted as 14 points.  No one play is worth that.

 

What if this 28-14 game was 28-0 with six minutes to go, and the scrubs scored a touchdown to cut it to 28-7, and then the leading team’s scrubs fumbled and gave up another touchdown with now four minutes to go.  The leading team then put their starters back in and drove from their 25 to the opposing 5 yard line before running out the clock.  This game could have been 42-0 if not for the reserves.  In a close game, those reserves will have little input in a future game.

 

2. What are the differences in your three ratings—PiRate, Mean, and Bias?

 

Answer: Okay, this one can be different depending on the year in question.  The PiRate Regular ratings stay the same every year.  They have not deviated since the advent of the Internet making statistical research so easy.

 

The Mean and Bias ratings have been tinkered with over the last 10 years.  In fact, the Mean rating has changed since 2011.  We perform 14 different calculations to start each season.  We look at returning lettermen and starters.  Each player at a positiong has a certain value, so that a returning starting left tackle earns the same points for Oregon and Alabama as it does for Georgia State and South Alabama.  This data is looked at many ways.  In one system, we may give more emphasis to the quarterback and wide receivers than in another system.  Our favorite calculation actually gives more weight to the interior lines than any of the skill positions.

 

After we calculate all the ratings, we adjust the previous year’s final rating for each team by the change in personnel entering this year.  For the PiRate regular rating, we take the 5 calculations that have always been used.  For the Mean rating, we take the 14 calculations and take the average rating.  For the Bias rating, we take the original 5 calculations and weight them a little differently.  Two of the calculations count 30% each; a third calculation counts 20%; and the other two count 10% each.  Thus, the PiRate Regular and Bias ratings will begin the season differing very little.

 

Additionally, each of the three ratings have a unique updating formula.  The PiRate Regular rating has the most conservative update and will not vary as much as the other two.  The Bias Rating has a more liberal update, and it will be more like the betting public and emphasize the most recent game over all others.  The Mean rating will usually have a smaller spread believing that the most recent game is part of a larger trend, but oftentimes overemphasized.  Thus, the Mean rating will frequently differ in the predicted winner when compared with the other two.  This is great for our purposes, for when the three ratings agree in a similar point-range, we believe this game is less uncertain than the average game.  In fact, over the last few years, when the three ratings take the same side of a selection, and the difference is two points or more on all three ratings, that selection has been the correct side about 62% of the time.  At 62%, you can get rich slowly if you have the courage to believe it will continue.  Of course, that 62% has a rather high standard deviation.  One year, the accuracy was just 46.4%.  One year, it was 73.1%.  One year, the number of plays this system generated exceeded 240 for the season, while just a couple years ago, there were only 97 plays for the season (which happened to be the 73.1% year at 68-25-4).

 

3. You once said that strength of schedule did not count for much in your system.  How can you be accurate then?

 

Answer: This statement is somewhat true, but let us explain what we mean.  We believe that the strength of a team lies in its talent, its teamwork, its coaching, and its commitment to win.  The schedule does not indicate how good a team may or may not be.  It may be how the rankings and BCS standings are determined, but we do not issue ratings to try to pick how the teams will be ranked or even which teams will play in the National Championship Game.  We want to rate the teams from best to worst and only care to compare which teams are actually better than others and by how many points.

 

Here is why strength of schedule is useless to us.  Let’s say that my friend the high school coach has just been hired at Old Dominion as the Monarchs move to FBS status.  In the first three years there, he successfully recruits the next Peyton Manning, Adrian Peterson, Calvin Johnson, Larry Fitzgerald, Brandon Marshall, Anthony Gonzalez, Maurkice Pouncey, Mike Iupati, Andy Levitre, Ryan Clady, and Joe Staley to start on offense.  On defense, he signs Geno Atkins, Vince Wilfork, J.J. Watt, Julius Peppers, Patrick Willis, Clay Matthews, DeMarcus Ware, Darrelle Revis, Charles Tillman, Earl Thomas, and Eric Berry to start on defense.

 

Without a doubt, no team in college football could equal talent like this.  Not only are these guys obvious first team all-Americans, every one is a future first team All-NFL.  Even Alabama could not compete against this team.

 

Now, this ODU team’s schedule is: Georgia State, Charlotte, Appalachian St., Louisiana-Monroe, Massachusetts, Troy, South Alabama, Louisiana-Lafayette, Arkansas St., Georgia Southern, Texas St., and Army.  There is no doubt that they will go 12-0 and outscore this dozen by about 500-700 points.  Yet, the strength of schedule may rank this team around #20.  If this were this season, they would not even compete for an at-large BCS Bowl Bid, and they would have to settle for something like the New Orleans or Military Bowl.

 

This has been the case in the past.  In 1970, Arizona State had the best team in the nation.  They did not get a chance to play in a big bowl and had to settle for the Peach, where they won handily.  Nebraska was two touchdowns weaker in 1970 than they would be in 1971, and the Sun Devils had the better team in 1970, when they ran the table and proved unstoppable on offense.

 

In 1969, Penn State was probably a little better than Texas.  The Longhorns’ new Wishbone offense proved to be an excellent weapon, but by the end of the season, teams had figured out how to slow it down.  Only a miracle comeback even got UT to the Cotton Bowl, and then in the Cotton Bowl, they had trouble with a very good but not great Notre Dame team.  Meanwhile, Penn State had perhaps the best college defense in the last eight years.  This defense and the special teams actually scored or set up the score for more points than they gave up.  Additionally, it was a team that went 11-0 for the second consecutive season and would place a host of players in the NFL.  How strong was that Penn St. team?  Their second and third running options were Franco Harris and Lydell Mitchell, two future NFL stars.  Their quarterback, Chuck Burkhart NEVER lost a game where he was the starting QB—that includes college, high school, and junior high—undefeated for life!

 

The end of the BCS era does not signal the end of this travesty.  Still, big name schools with gaudy schedules will beat out other schools for one of the four playoff berths.  There should be no selection of playoff berths.  There should be set guidelines that allow each team to qualify for a berth by winning on the field just like the NFL.  The last several Super Bowl Champs might never have been in the playoffs to begin with if they had to be selected as one of the top four teams.   Baltimore would have been left out last year.  The Green Bay Packers and New York Giants would not have qualified when they won their most recent Super Bowls.  It is our opinion, that this tournament needs to be eight-deep with each of the eight teams qualifying by winning on the field and clinching a spot based only on games played and never on human selection.

 

5. You used to report for Vanderbilt, and you stated that you married into a University of Wisconsin and Green Bay Packer family.  How do we know that you do not fudge on these teams and rate them higher than they deserve?

 

Answer: You are confusing ranking and rating.  Ranking might bring into play human partiality, but we are trying to rate teams based on how this rating can be used to select against the spread.  We would be quite happy for these three teams to win every week, but what most excites us is picking all the winners against the spread.  So, our love of being accurate is really all that matters.  We have no influence over the rankings, so it really matters not which teams we cheer for.  And, to tell you the truth, some of us root for different teams.  And, we are not fanatical fans.  Our founder has cultivated friendships with athletic officials at numerous schools including those at the University of Tennessee, the University of Minnesota, and personnel with the Chicago Bears and Cleveland Browns.  He never roots against anybody.  His love of the game is what keeps his interest going, and as a long-time coach in football and basketball, his first love is watching teams practice.  As most long-time coaches will agree, they miss the practices when they retire.  They don’t really miss the games, the schmoozing with alumni, the media, etc.

 

6. What happened to your Computer Simulations?

Answer: We regret to say that we lost access to the college campus computer that allowed us to run these simulations.  So, unless this changes, we will not be able to offer this service in the future.

 

7. I want to make my own ratings.  Can you offer help?

Answer: This is one we get a lot.  If you want to make your own ratings, do what we did when we started out in 1969.  Begin with your own personal belief about each team.  Begin with each conference and rank the teams within the conference.  Then, take the best teams in each conference and rank against each other.  It should look something like it looked for our founder in October 1969:

 

Southwest Conference:

Arkansas 0, Texas -1, Texas Tech -27, TCU -29, SMU -30, Texas A&M -30, Rice -34, Baylor -41.

 

He did this for every conference as well as the numerous independents, which he had broken down into four regions since there were so many then.

 

At the time, Ohio St. was number one overall.  They received the top rating at 120, or 20 points better than the average team and about 40 points better than the typical weak team.  He had Arkansas as the third best of the teams, about 3 points weaker than Ohio St.  Thus for the SWC, the teams had these ratings:

 

Arkansas 117, Texas 116, Texas Tech, 90, TCU 88. SMU 87, Texas A&M 87, Rice 83, and Baylor 76.

 

At the time, he gave every team with a large stadium 4 points home field advantage, every team with an average stadium 3 points, and every team with a small stadium 2 points.

 

After each game, he raised or lowered the rating from 1 to 6 points based on the outcome of the game, or left it the same.  Whatever he gave to one team, he took the opposite away from the other.  It was crude, but he was 9 years old.   

8. Have you ever considered using more colors in your blog?

Answer: That was a great suggestion, and we took your advice this summer and began using team colors.

Advertisements

August 25, 2007

How The Pi-Rate Ratings Came To Be

Filed under: How The Pirate Ratings Began — piratings @ 7:20 pm

How The PiRate Ratings Were Born

 

 

It was Mid-October 1969, and I was a third grader in Nashville, TN.  Every day at recess, the boys and a few girls played touch football on the school grounds. 

All year, the team I captained called itself Ohio State, since the Buckeyes were the defending National Champions.  The other team called themselves Penn State because the Nittany Lions had gone 11-0 in 1968.  To this point in the season, both teams were undefeated yet again with “our” Buckeyes number one and blowing out teams every Saturday.

It was at this time that I began carefully perusing the sports pages of our two local papers.  Before school started, I read the Nashville Tennessean sports page.  After school, I read the Nashville Banner sports page.  Each paper carried football ratings.  The Banner carried ratings by a local Vanderbilt University professor named Dr. Ed Litkenhous.  I couldn’t wait for his weekly ratings to show how big Ohio State’s next blowout would be and if Vanderbilt had a chance of upsetting its opponent.

What started me on my way to devising my own ratings began when I noticed one week that the entire AP Top 10 consisted of undefeated teams.  I kept a copy of that week’s rankings showing Ohio State, Texas, Southern Cal, Arkansas, Penn State, Missouri, Tennessee, UCLA, LSU, and Florida all without a loss.  How could someone determine which of the 10 was the best of all?  I started comparing scores trying to compare one team’s win with another team’s win over the same or similar opponent.  Right away, I noticed both Ohio State and Arkansas had played TCU.  The Buckeyes pasted the Frogs 62-0, while Arkansas only beat them 24-6.  Both Texas and Penn State had clobbered Navy, but Texas won by 39 while the Lions won by only 23.

Of course, I looked for any reason to prove Ohio State was the best team, and they appeared to be just that until they ran into Michigan in Ann Arbor for the final game.  The Wolverines were ready for revenge after Woody Hayes called for a 2-point conversion at the end of the 1968 game.  The only problem with that was the Buckeyes were leading 48-14 at the time, and after converting the try, they won 50-14.  Woody Hayes made a snide comment that he went for two because he couldn’t go for three.

First year Michigan coach Bo Schembechler had a strong and fired up group of Wolverines, and the Michigan defense totally stopped Ohio State that day, with Wolverine defensive back Barry Pierson being Buckeye quarterback Rex Kern’s leading receiver.

By the end of November, all but Texas, Arkansas, and Penn State had either lost or tied a game.  My math showed that Texas would beat Arkansas by a touchdown, while Penn State was just as strong as the other two.

It wasn’t a ratings service or polling company that determined the 1969 National Champion.  President Richard Nixon himself declared the winner of the Arkansas-Texas game would be the national champion, and he would be on-hand to present the victors with a plaque saying as much. 

The “Game of the Century” lived up to its billing, as Texas trailed 14-8 late in the game.  On 4th down inside their own territory, Longhorn coach Darrell Royal gambled and went for the conversion.  Arkansas bunched up their defense near the line to stop the powerful Texas Wishbone attack.  Royal gambled, using the National Title for poker chips.  He ordered a play-action long bomb, and it worked!  A couple of plays later, the pride of Hudson, Wisconsin, Jim Bertelsen, leapt into the end zone giving Texas the 15-14 win and the coveted plaque.

That wasn’t the end of the story as far as I was concerned.  In the bowls, Arkansas lost again to an Archie Manning-led Ole Miss team.  Texas struggled and had to come from behind once again, this time against Notre Dame.  Penn State’s defense stopped a Missouri team that regularly scored 40 points per game.  My personal ratings showed Penn State the best team in the nation.  An LSU team, at 9-1, was supposed to play Texas in the Cotton Bowl, but when Notre Dame decided to end their ban on bowl games, the Tigers were left out in the cold.  My ratings revealed that LSU, with an A+ defense against the run, might have beaten Texas that year.  Penn State’s offense was more balanced, and their defense was about as good as any college team in the past decade.  Joe Paterno’s stop troops and special teams scored or set up more points than their defense allowed!

That was all it took to start an annual labor of love that has continued since October of 1969.  Over the course of the next four decades, I refined the ratings many times, but I always used the prior year’s final ratings as the base for the subsequent year.

In the fall of 1979, these ratings began to bear fruit.  As a freshman at Tulane University, my ratings appeared weekly in the Tulane Hullabaloo, the campus newspaper.  The Hullabaloo was in the middle of a multi-year run as the holder of the prestigious Pacemaker Award, considered to be the Pulitzer Prize of student journalism. 

In the Friday, November 9th issue of the Hullabaloo, I made the prediction that would affect my life forever more.  Of all teams, it had to be the arch-enemy of the team I grew up pulling for week after week.  Yes, the Tennessee Volunteers, a team that had made an annual habit of ending my Vanderbilt Commodores year on a sour note gave me my big break.  The Vols had just suffered an embarrassing defeat to a Rutgers team that would lose to Villanova in a few weeks.  At 4-3, the Big Orange was now 13-15-1 under head coach Johnny Majors.  Notre Dame was a prohibitive favorite, yet I not only called for Tennessee to win the game outright, I predicted it wouldn’t be close.  About 24 hours after the paper came out with my prediction, Tennessee trounced the Irish by more than three touchdowns.  To add to the joy and by great fortune, that Sunday, all but one NFL team I had picked to win did just that.

The next week, I began to receive phone calls from multiple sources.  While two may have been from immoral people I didn’t want to get involved with, one came from a New Orleans radio station.  A week later, I made my radio debut with the ratings as a guest on the Champ Clark Show in New Orleans.  It only lasted one week, but that was all it took to convince me to drop my pre-med major and become the next Jimmy “The Greek.  Within a year, I was now a broadcast journalism major and a weekend sports announcer on WLAC radio in Nashville.

In the late summer of 1981, I was asked to host a weekly radio program on the Tennessee Radio network.  Football Forecast aired on about 45 stations with my ratings predicting the outcomes of college football games.  It turned out to be a successful year, as I “beat the spread” almost 70% of the time.  That was the pinnacle of my media career, and I gave up the profession in 1983 when I decided that it would be nice to have something in my refrigerator rather than empty space.  So, I became a general contractor for the next 18 years.

In 2001, I accompanied my then fiancée to Boulder, Colorado, when she was offered a great position she couldn’t refuse.  We married soon after that, and I was now a house husband for the time being.  It was during this time that I met someone at the University of Colorado who lived and breathed college football as much as I did.  He had ratings based on scientific principles I never could have imagined, but my ratings actually were a little more accurate.  He convinced me to give my ratings a catchy name and try to market them.  Thus, the name, “PiRate” was born.

We returned to Nashville in the spring of 2003, and that year, my ratings went public once again.  Vanderbilt University’s fan website “Vandymania” had been a source of entertainment for me when I lived 1,200 miles away from Nashville.  The board moderator, Don Yates, asked me to supply my ratings and prognostications for Vandymania.  Additionally, I began writing historical pieces for the website.  When Don decided to issue magazines for football and basketball, I supplied lengthy pieces for both.  In 2006, I added regular news and feature articles as well. 

At the end of the year, I sadly left Vandymania due to a host of factors, mainly because it was taking almost as many hours to do the work as it took with my regular career.  So, that’s why you see this blog today.  It only takes about 10 hours a week to keep things updated and I don’t have to cover daily team practices.  For what it’s worth, you will get no pro-Vanderbilt or pro-Ohio State biases.  Actually, since I married a Wisconsin beauty and became partly a Wisconsin resident, I have adopted UW and the Green Bay Packers as my two favorite teams, but you still won’t see favoritism to “my Badgers” or “my Pack” in 2007.  I guess years of pulling for Vanderbilt have made impartiality second nature.

Create a free website or blog at WordPress.com.