Friday, December 25, 2015

Approximating the Yardage of an Interception in the Aggregate

So, it is established that an interception is valued at about 60 yards, an increase from the 45 yards it was previously ascribed. The model used to establish that value of 60 yards is one of several based on expected points (EP), this one developed by Brian Burke. EP models provide the average amount of points expected to follow a play on a given down, with a given distance to go, and from a given spot of the ball, based upon the average next-score for all previous plays with a given down, distance, and field position. The next-score may occur on the forthcoming play, the following play, or on a play three possessions later. The next-points could be scored by the offense (TD, FG), the defense (INT or fumble return for TD, safety), or maybe the defense's offense (following TO, turnover on downs, punt or otherwise). Positive EP values indicate offensive success and negative values, failure. 

Estimated points can then be converted to yardage values. For instance, 1st and 10 at the 50-yard line carries +2.0 EP. That indicates that, across many, many 1st and 10 situations at the 50, in many games, and in many seasons, the average next-points equals +2.0 EP. Likewise, 2nd and 8 from the opponent's 48-yard line will carry its own EP.

Anyhow, the value of 60 yards is derived from the expected point difference between interception plays and non-interception passing plays, across teams in many seasons. That is, the average EP for all non-interception passing plays from all down, distance, and field position situations compared to that average for all passing plays resulting in an interception. The EP difference between non-interception and interception pass plays is +3.8. For the offense, the EP value of +3.8 is equitable, roughly, to having the ball at the opponents’ 20 yard line. EP for the offense equal zero when the ball is at an offense’s own 20 yard line. The difference of the two field positions is 60 yards, hence the 60-yard valuation of interceptions.

I used Burke’s work to guide my development of team-specific, aggregate yardage values for interceptions. Of course, I sought a yardage value individualized for each team and, accordingly, EP for given down, distance, and field position situations are known to vary by team for teams' offenses and defenses. However
—foreshadowing—computation of within-season team EP values is confounded by a small sample size. Anyways, like EP, an interception yardage value should also vary by team—but how? Well, these were my criteria: INT-yardage should
 

Figure 1.
  • increase for teams with productive offenses (as measured by yards per drive and plays per drive), 
  • increase for teams with efficient scoring offenses (as measured by % of drives end in a score), 
  • decrease for teams that struggle to limit the productivity and scoring efficiency of opposing offenses (as measured by allowed yards per drive and % of drives ending in a score), and
  • decrease for teams turnover prone offenses (as measured by % of a defensive team's offensive drives ending in a turnover).

To start, I sketched a football field and partitioned the field according to defensive drive start and opponents yard per drive. We can sum these two values, which I did for all NFL teams from 2010 through 2014. However, we then subtract that value from 100 ensuring a greater value for defenses that allowed fewer yards. This process, I was certain of and we’ll term it the Defensive Component.

I was less certain of how to include team offensive starting position and offensive yards per drive. Rather surreptitiously, I summed those two values with the Defensive Component above and noticed that the mean across team seasons equaled 100.044. I got excited and termed it the Offensive Component.


I simply subtracted 40 from the sum of the Defense and Offensive components. Voila, the average was 60.044.  Normality for the entire data set appears in Figure 1 with the distribution plotted in orange against a normal curve. In Figure 2 we see that the average of 60 yards is stable across all seasons in the data set, as are the centralities of the standard deviations. 
Figure 2.

The greatest yardage value was 73, for the 2012 Denver Broncos and 2011 New Orleans Saints and the least was 45, for 2014 Oakland Raiders and 2011 Indiana Colts. By several metrics (this one and this one),  Denver ranked among the top offenses and defenses, the New Orleans offense ranked top 1 or 2, Oakland amongst the lowest in offense and toward the bottom in defense, and Indiana relegated itself to the lower bounds offensively and defensively, in their respective seasons. 

Analyzed next were the relationships between interception yardage values and various team-offensive and -defensive attributes bulleted above. As seen in Figure 3 at the bottom of the page, most potent were the rate of offensive scoring drives increasing and rate of scoring drives allowed decreasing with increased yardage values.1 Likewise, the rate of offensive turnovers decreased as interceptions yardage values increased. These associations are ecologically valid because only some interceptions are a pick-six—12.5%—and the defense depends on its offense to capitalize. Absent from Figure 3 is a small r = -.19 (p = .01) for the relationship between Defensive plays per drive and interception yardage.

Also, Pro Football Reference provides EP values for plays so we could use these to compute EP values for, say, the 2012 Denver Broncos.2 Following Burke's methods, we compute the average EP for all non-intercepted, non-4th down passes thrown against the ’12 Broncos defense. Separately, we compute the EP for passes intercepted by the Broncos. Because it is such a small sample size, I also computed League-wide average EP on interceptions for 2012. Non-intercepted, non-4th down passes equaled +2.11 EP and intercepted passes equaled -2.73 and -3.02 EP for league and team averages,  yielding differences of +4.83 and +5.14 EP, respectively.


We could plot non-intercepted pass EP values by field position, as I did initially. Using only the ’12 Broncos’ data, EP is first less than zero at the Opponents’ 35 and EP is first greater than 4.31 at the Broncos’ 29 or so. That would make the INT yardage value 36. Meh....the perils of inadequate power. (For example, see this supplementary figure [green = non-INT] and compare it to Burke's graph in this write-up. The INT EP is League-wide 2012 averages. On my figure, that sharp dip in INT EP around the 95 is the result of insufficient.)

Figure 3.

So, as an alternative approach, I computed the average yard-line field positions for EP ≤0,
≥4.83, and ≥5.13 for non-interception pass plays. For non-interception pass plays against the Broncos D, the average EP ≤0 was about the 23-yard line. Using the difference of the League average INT EP, the average field position was 91-yard line (DEN 9). Using the difference of the Broncos team INT EP average, the average field position was the 94 (DEN 6). That puts the differences at between 69 (league) and 71 (DEN) yards. Recall, the value estimated above for the Broncos was 74; so we're fairly accurate, between +2 to +3 yards using the aggregate method I outlined above. But that's only one team.

It's a fairly simple process—obtaining the PFR EP—but I lack the motivation to check for all teams in seasons 2010-2014. I did check the 2011 Indianapolis Colts. Non-intercepted, non-4th down passes against the Indy' D yielded an average +2.19 EP; League INT, -2.5 EP; and Indy team INT, -2.8 EP. Those EP values equate in field position to ~26 (≤0), 82 (League), and 82 (IND). Thus, the difference equals ~56 yards, or, a difference of about 9 yards from the formula I described above.

Given that disparity, I also checked the 2014 Oakland Raiders. Non-intercepted, non-4th down passes against the Raiders defense yielded an average +2.11 EP; League INT, -2.73 EP; and team INT, -3.03 EP. Those EP values equate in field position to ~28 (≤0), ~78 (League and OAK INT). Those both yield yardage differences of about 50. This is only +5 yards than the 45 I mentioned earlier.

In summation I introduced here a method of computing team-specific yardage values of interceptions. It is well-established that that value is about 60 yards but that value is more so a League average, per se. So, I cross-checked the interceptions yardage values for several teams using estimates based on the EP differences (similar to the method used to obtain the 60 yard value). There were discrepancies between the results of my aggregate method and the EP estimates, two of which were |5| and one was +9. These discrepancies may be due to mathematical failures on my behalf or the crude computation of average field position differences for EP values. It could also be that Burke and PFR obtained EP values with different models. Of course, it could be some other issue that I have overlooked.
 





Footnotes:

1The decimal values in Figure 3 are Pearson Correlations NOT Linear Regression Coefficients. This is because we are simply interested in relationships between variables (i.e., correlations) not explaining variance of the INT yardage values. However, the fuzzy line for each correlation is based on the linear regression equation. I included the line for convenience in visualizing the relationships.
2Some plays in the PFR lack EP data so those were removed from analysis unless it was a pick-6, in which case I made the EPA -7.



Tuesday, December 22, 2015

Passes Defensed on Standard Downs Compared to Passing Downs: Are Some Defenses More Aggressive than Others?

Football is largely a game of competing strategies. Aside from coaches’ philosophies, players’ executions, and those of opponents, strategizing is dictated by fluctuating situational factors within each game. One factor is garbage time which occurs when a team is winning or losing by a large margin. Here, winning offenses might play more cautiously to maintain their lead whereas losing defenses might take risks to reduce the scoring margin. Likewise, losing offenses might pass the ball more frequently attempting to score rapidly whereas winning defenses might play to prevent large passing gains. We will revisit garbage time shortly.

A second factor or set of factors influential in determining strategy are standard and passing downs. Standard downs are defined as 1st downs, 2nd & ≤ 7, and 3rd or 4th & ≤ 4. Passing downs are defined inversely; 2nd & ≥ 8 and 3rd or 4th & ≥ 5. Extreme philosophies notwithstanding, on standard downs, offenses could pass or run with equal likelihood given the yards needed to secure a first down. Alternatively, on passing downs, offenses should be more likely to pass the ball given the yards needed to secure a first down. In college football the distinction is generally reflected statistically: Prior research indicates that offenses will pass on ~40% of standard downs and on ~67% of passing downs.

I am curious if passes defensed (hereafter: PD)—pass break-ups and interceptions—occur more frequently on passing or standard downs. Defenses should be attuned to what is coming on passing downs (i.e., a pass), should adjust their personnel (e.g., more men in coverage), and passes should be defensed more readily. Alternatively though, the opposite may be true if a defense is atypically aggressive. Summarily, I expect that PD occur more frequently on passing downs. Of course, we will use proportions (e.g., passing down PD/passing down PA) to mitigate the greater quantity of passing known to occur on passing downs. 


So, to start, I randomly selected 27 D1 games from 2014.1 Play-by-play data of some games required considerable manipulations to fit in the MS Excel parsing system I devised; those were excluded. The sample was too small in my opinion—14 games—but then I remembered the publicly available data from the Football Study Hall 2013 Charting Project; much thanks is due.  It contains play-by-play data from 202 games. I combined that with my comparatively minute data set and computed PD proportions for passing and standard downs for each team in each game.

Non-normal distributions of the standing and passing down PD proportions obligate the use of a Mann-Whitney test. This test compares group median instead of average and lacks assumptions of normal distribution which, if violated, could undermine the results when using techniques that compare averages. That is, the proportional PD data are non-normal.

PD were found to occur more frequently on passing downs than on standard downs (Uobserved = 77734 < Ucritical = 84127, z = 3.74, p < .001, two-tailed). The median proportion of PD for passing downs, .125 (IQR = .161), was greater than that of standard downs, .097 (IQR = .11), a difference of .028 (95% CI ± ~.014). An effect size of .12 indicates a small to medium difference.

The results corresponded to my expectations but we do need to account for garbage time because defenses adjust their protections. Winning offenses may abstain from passing to prevent PD and INTs that stop the clock and forfeit possession, respectively. Winning defenses may become more amenable to completions underneath coverage while preventing large gains (i.e., less likely to attempt PBU or INT). To adjust for garbage time, I computed PD proportions for passing and standard downs occurring outside of garbage time. The results are similar but the difference is less pronounced. The median proportion of PD on passing downs, .118, was greater than that of standard downs, .10, a difference of .018 (z = 3.02, p =.003). An effect size equal to .07 indicates a small but significant difference.

The results support the hypothesis that a greater proportion of passes thrown on passing downs are broken-up or intercepted than on standard downs. But what else can we glean from this data? We can gain insight into team defensive tendencies, that is, how aggressive a team is at defensing passes.

Although voluminous and grand, the FSH data set contains only 202 of the 868 games played in 2014. Thankfully, however, the project was crowd sourced to who?—to fans. It appears several devotees charted all or nearly all (-1 or -2) games of their beloved warriors. Those teams appear in the table below.


Table 1. Sampling NCAA Team Defenses PD% on Passing and Standard Downs, non-Garbage Time
Passing Downs Standard Downs PD%
Team Games PA PD PA PD Passing Downs Standard Downs sdPD% / pdPD%
Virginia Tech 12 184 35 154 28 0.190 0.182 0.956
Illinois 10 104 6 164 9 0.058 0.055 0.951
Northwestern 12 153 26 254 36 0.170 0.142 0.834
Oklahoma 13 176 31 211 30 0.176 0.142 0.807
Cincinnati 10 116 20 138 18 0.172 0.130 0.757
Kansas State 11 132 21 184 19 0.159 0.103 0.649
Washington State 11 135 21 232 18 0.156 0.078 0.499

In the rightmost column we find the ratio of PD on standard downs to PD on standard downs. As that value increases, ostensibly, it indicates how aggressively a defense makes plays on balls in the air. That is, teams that defense more passes on standard than on passing downs may be more aggressive. However, this is not granted; it may be that a team's defense faced pass-drunk teams or faced trailing teams passing to score quicker outside of garbage time. Also unaccounted for is the effectiveness of that aggressiveness, Illinois.

An existing metric, PD-to-INC, or PD to incompletions, is used to gauge defenses' aggressiveness defensing the pass. So, I compared sdPD%/pdPD% to PD/INC and that can be viewed in the table below. The stats used in computing the values shown in the table were culled from College Football Stats. We find some nuance there because, with PD/INC Kansas State appears to be the second-most aggressive defense within this small sample. However, in sdPD%/pdPD% K-State falls to fifth in our set.



Table 2. Comparison of sdPD% / pdPD% to PD-to-INC
Team PD Att. Inc. PD / Inc. pPD%/sPD%
Northwestern 70 445 179 0.391 0.834
Kansas State 68 458 181 0.376 0.649
Virginia Tech 70 363 188 0.372 0.956
Oklahoma 62 409 184 0.337 0.807
Cincinnati 57 438 184 0.310 0.757
Washington State 48 458 172 0.279 0.499
Illinois 31 354 123 0.252 0.951

So, in conclusion, passes are defensed more frequently on passing downs than on standard downs. Also, I have suggested that the greater the ratio of PD on standard downs to PD on passing downs, the more aggressive a defense. Virginia tech ranks atop my small sample and there is some support for this notion that the Hokies' secondary and coverage backers were a ball-hawking bunch. However, a shortcoming of the ratio: it provides no indication of effective pass defensing. As it is with science though, we must draw conclusions other than a "shortcoming." Considering the complexities inhere in football, it may be that an aggressive secondary may be rendered less effective by an inadequate pass rush or that its aggressiveness exceeds the execution of its coverage personnel, both of which appear to be the case for the 2013 Illini.


1 I assigned each 2014 FBS football game a random number between 0 and 999,999. Next, a list of random numbers between 0 and 999,999 were generated until 27 of those corresponded to a 2014 FBS football game. Beforehand, I anticipated using a Washington State game (highest rate of passing in ’14), a Louisiana Tech game (tied for 1st in total interceptions, 7th in pass break ups), and a Louisville game (Gerod Holliman tied NCAA D1 record of 14 INTs). Then I remembered the FSH data set so the U of L game was excluded.

Sunday, December 13, 2015

Should Offensive Line Holding and Intentional Grounding Penalities be Included in Havoc Rates?

Havoc. ©Getty Images, 2015.
If you’re a fan, you’ve lived it: Havoc. We bargain with disinterested gods for retribution in the form of pass interference because their corners have batted away our every pass and must be defrauding the game; we shriek obscene declarations and demand goblets of enemy blood when our defense stuffs their speed back at the edge…again; we resign to stormless disharmony with a slightly lowered heart rate as our redshirt freshman tackle falls on our quarterback’s fumble. It’s havoc. And as an aspiring defensive back, I love havoc too.

Pioneer Bill Connelly of Football Study Hall defines Havoc as the percentage of plays in which a defense makes a tackle for loss, forces a fumble, or defenses a pass (by interception or break up). Connelly notes that hurries on the QB or QB hits would be included in Havoc if the stat was more consistently recorded. As I often do, I began wondering if there were other, more reliably registered statistics that could be included to account for pressuring of the QB.

Kentucky-Tennessees game are required viewing for all KY residents. During the 2015 football iteration, the idea of considering in Havoc holding against offensive lineman happened. On their last drive of the 3rd quarter, UK O-linemen were penalized for a block in the back and a hold and also surrendered a sack.  UK’s first drive of the 4th quarter produced two more holding calls and the next drive ended when UT recovered a forced fumble; the previous two drives concluded with a punt and a turnover on downs, respectively. UK scored zero points on those three drives that spanned 16 plays (i.e., excluding penalty-plays and punts).

If you happened to see these sequences you would know the UT front-7 were Kieth-Moon-in-a-hotel-room in the UK backfield. Thusly, the UT defense would receive a Havoc rating of 18.8% for those three possessions (3/16)—slightly better than the 2015 national average of 16.1%.  However, if we also include those 4 penalties in that equation, UT’s defense nearly doubles Alabama’s nation-leading 23.1% with a suffocating 43.8% Havoc.

Speaking of the Crimson, I watched their D generally smother LSU’s hopes of moving the chains forward. In the fourth quarter, LSU QB Brandon Harris completed a pass for 2 yards to ineligible left tackle Jerald Hawkins—an illegal touching penalty Saban declined.    Upon seeing that, I thought that intentional grounding may also provide an alternative measure of QB pressure, as well.

I had zero desire to gather enough college game play-by-play summaries to warrant a reasonable sample. So I started with NFL play-by-play data from 2014 and 2015. I inspected correlations between game-by-game sacks allowed and offensive holding penalties (not per game, i.e., n = ~1400). Found no appreciable relationship there nor between sacks and false starts. I supposed I could have computed game proportions but was feeling uninspired so I shifted my focus to the season in aggregate.

That the NFL provides cumulative QB hit data is a benefit of using seasonal data.  Likewise, I serendipitously discovered NFL Penalties dot com which allowed me to extract team-offensive lineman holding penalty data.  I also extracted intentional grounding penalties. Plus, the site offers declined and offsetting penalties, which I included in the analyses. Next, I computed several proportions for all NFL teams 2009 through 2014:
 

  • O-lineman holding calls / total offensive plays; 
  • intentional grounding calls / (pass attempts + sacks); 
  • QB hits allowed / pass attempts. I excluded sacks from the denominator because a TD pass and QB hit can occur on the same play whereas a sack ends a play. Similar distinctions have been made in the literature;  and
  • team totals for QB rushing attempts, which exclude sacks.   I expected that this might somehow interact with the aforementioned variables.
Inspected first were correlations of pertinent variables. Those appear in the figure below and given the association between QB hits and QB rushes, we know that accounting for QB rushes will be necessary. Do note that I excluded Intentional Grounding proportions equal to zero in the figure but included zero values in the analysis. Also excluded from the figure is the relationship between O-linemen holding and QB rushing, which also needed to be accounted for, r = .19. 


Next, we regress QB hits onto QB rushes and obtain the residual values (i.e., the values if the two variables are unrelated), R2adjusted = .062, F(1,190) = 13.57, p < .001. We then regress O-Lineman holds onto QB rushes and obtain those residual values, R2adjusted = .03, F(1,190) = 6.96, p = .001. Intentional grounding was unrelated to QB rushes.

Lastly, we regress the O-Linemen holding residuals onto QB hit residuals. This regression revealed that, when controlling for QB rushing, QB Hits accounted for 4% of the variance in O-Linemen Holding penalties,
R2adjusted = .04, F(1,191) = 8.6, p = .004. Similarly, when controlling for frequency of QB rushing, QB hits accounted for 2% of the variance in Intentional Grounding penalties, R2adjusted = .02, F(1,190) = 4.76, p = .03. More ecologically, when intentional grounding and O-linemen holding penalties increase, it is expected that QB hits are probably increasing.

The explained variances are paltry, indeed, however significant. This finding would potentially be alleviated, or at least a more sound explanation elucidated, if the variables were examined on a game-by-game basis. I checked and OL experience was inversely related to the penalties and to QB rush frequency. I could have controlled for experience but declined to do so since correlations were weaker than each of the others reported above.


It is also worth noting there is a meager relationship of holding with sacks that is negated when controlling for QB rush rates. Likewise, either controlling for or ignoring the influence of QB rush frequency, OL holding calls are essentially unrelated to negative rushing rates (i.e., negative rushes / rushes). This latter point underscores another shortfall of the current examination: In future analyses, it would be beneficial to separate OL holding penalties for pass and rush plays. Lastly, the data examined here is from NFL data. It may be the relationship of these penalties and QB hits is more pronounced or altogether absent in the college game.

In conclusion, I advocate here for, if not the inclusion of, then the further analysis of the effect of including opponents' holding penalties by offensive lineman and intentional grounding penalties in the calculation of college football Havoc rates. I would lean to the latter because intentional grounding penalties are infrequent and generally resultant of a QB overwhelmed by the pass rush. I also wonder if blocked kicks and punts should be included in Havoc rate. Although a distinction must be made between special teams and defensive, blocks do occur on defensive special teams plays. Also, D-Linemen and LBs tend to lead the nation in blocked kicks and punts.

Sunday, November 22, 2015

Longest Yards-To-Go Situations in NFL and College Football, A Sampling

Al Abrahms, Pittsburg Post-Gazette 10/26/1970.
 Friday 27 November 2015. Update:  I have updated Table 1 to include the Patriots 4th and 63 versus Cowboys in 1971 as well as a Panthers' 4th and 40 versus Cowboys on Thanksgiving 2015.
Saturday 22 October 2016. Update: I have updated Table 2 to include the Army 2nd-4th and 44 versus Lafayette on 15 OCT 2016. 
Thursday 24 November 2016. Update: I have updated Table 2 to include additional lengthy down-and-distance situations in NCAA football seasons 2005-09.
Monday 24 November 2025. Update: I have updated Table 2 to include two additional lengthy down-and-distance situations that recently came to my knowledge. One from watching Secret Base.
 

So I was watching college football like I do every Saturday in the fall. Amen. Actually, for personal reasons, I was tardy tuning into the noon-round of games. Checked a couple games and landed on Auburn-Georgia. Georgia possessed the ball at their 29-yard line early in the 4th quarter. It was 2nd and 37. SECOND AND 37!

I later learned that UGA’s 2nd and 37 was made possible by an offensive pass interference call (1-25), a false start (2-30), and a holding call tacked onto a 3-yard run (2-37). My girlfriend and I were baffled. UGA running back Brendan Douglas rushed to the right for a 1-yard gain. Indeed, 37-to go is intimidating. But then—UGA surrendered 5 additional yards on a delay of game penalty! On 3rd and 41 Douglas again rushed to the right and managed a stellar but unsuccessful 20-yard gain.

Thereafter I wondered what the longest yards-to go situation has been. Data of this sort is readily accessible for NFL games. However, college statistics encompass 3 or more divisions and the data are much more diffuse. So the NFL first:

Table 1. Sampling of Lengthiest Down and Distance Situations in NFL
Date Team Opponent Quarter Down Location Score Detail Yds
10.25.1970 Steelers Raiders 1 4-74 PIT 9 0-7 Probably punt -
12.20.1999 Vikings Packers 1 3-50 MIN 41 0-0 Jeff George pass complete to Leroy Hoard 7
09.23.2012 Redskins Bengals 4 3-50 WAS 41 31-38 Robert Griffin III pass incomplete -
10.28.2001 Eagles Raiders 1 2-48 PHI 16 0-0 Duce Staley run 17
10.13.2013 Raiders Chiefs 4 3-48 RAI 12 7-14 Terrelle Pryor pass incomplete -
12.14.1997 Bills Jaguars 1 3-47 BUF 26 0-0 Thurman Thomas run 6
11.09.2014 Jets Steelers 4 3-46 NYJ 22 20-6 Chris Ivory run 9
11.19.1995 Seahawks Redskins 4 3-45 SEA 2 17-10 Rick Mirer pass incomplete -
11.21.1999 Browns Panthers 4 2-45 CLE 10 3-31 Tim Couch pass complete to Terry Kirby 6
09.15.2002 Bengals Browns 4 4-45 CIN 37 7-20 Gus Frerotte pass incomplete -
11.09.1997 Saints Raiders 4 1-44 NOR 9 10-10 Ray Zellars run 14
11.14.1999 Redskins Eagles 4 2-43 PHI 43 27-27 Brad Johnson pass complete to Michael Westbrook 43
09.13.2015 Buccaneers Titans 3 3-42 TAM 11 7-35 Jameis Winston pass incomplete -
01.06.2002 Browns Steelers 3 2-41 CLE 5 7-14 Jamel White run 3
12.02.2001 Saints Panthers 4 2-41 NOR 26 20-13 Aaron Brooks pass incomplete -
12.02.2001 Saints Panthers 4 3-41 NOR 26 20-13 Aaron Brooks pass intercepted by Jimmy Hitchcock returned for 35 yards -
11.13.2005 Vikings Giants 3 3-41 MIN 42 14-13 Brad Johnson pass complete to Michael Bennett 2
10.02.2005 Bengals Texans 3 3-40 HTX 40 10-10 Carson Palmer pass complete to Chris Henry 15
12.24.1995 Jets Saints 3 3-40 NYJ 2 0-6 Bubby Brister pass complete right to Johnny Mitchell 11
09.23.2007 Browns Raiders 1 3-40 CLE 20 0-0 Jason Wright run 13
10.12.1997 Cardinals Giants 3 2-40 CRD 15 6-13 Stoney Case pass incomplete -
10.12.1997 Cardinals Giants 3 3-40 CRD 15 6-13 Stoney Case pass complete left to Larry Centers 9
12.30.2007 Seahawks Falcons 2 3-40 SEA 49 10-7 Matt Hasselbeck sacked by John Abraham, fumbles, Jonathan Babineaux returned for 11 yards -6
12.04.1994 Steelers Bengals 1 3-40 PIT 14 7-7 Bam Morris (?) run for 3 yards (tackle Dan Wilkinson, Tim Krumrie) 3
10.24.1971 Patriots Cowboys ? 4-63 ? ? Probably punt -
11.26.2015 Panthers Cowboys 3 4-40 CAR 2 23-3 punt -
That the Steelers faced 4th and 74 in 1970 is somewhat of an historical precedence.1 Considerable discussion abounds on the internet of a 4th and 64 faced by the Patriots against the Cowboys in 1971 as the lengthiest down-and-distance situation in the NFL but I failed to secure an original source.

Football miscalculations I will abstain from recounting yielded the Cleveland Browns’ offense three down and distance situations >= 40-yards in three separate games. Brad Johnson would appear twice on this list, for two separate drives, for two separate teams nonetheless. Fortunately for them, Washington never faced such a distance. As Philadelphia Daily News writer Marcus Hayes noted, Washington “took the lead on a two-play, 91-yard drive – passes of 48 and 43 yards to Westbrook…” Simply a recording error by League statisticians. Let us shift to college football: 


Table 2. Sampling of Lengthiest Down and Distance Situations in College Football
Date Division Team Opponent Quarter Down Spot Score Detail Yds notes
09.09.2017 FBS Louisiana Tech Mississippi State 3 3-94 LAT 7 14-57 Boston Scott 21-yard rush. 21 Is a 3rd and goal but previous play was 86-yard loss on a fumble. Punt on 4th down. (Thanks to Secret Base)
10.21.2004 FCS Northwestern State Nicholls State 3 3-61 NWS 2 14-33 Connor Morel pass incomplete (punt on 4th) -
09.14.2024 FBS Missouri Boston College 3 2-58 Mizz 14 24-14 N. Nole rush for 24 yards. 24 Caused by a series of penalities. 6-yard rush on 3rd down, punt on fourth.
10.08.2011 FBS Georgia Tennessee 4 4-57 UGA 31 20-6 Butler, D. punts -
11.12.2011 USCAA Concordia-Selma Stillman College 1 4-54 SC 25 0-7 Ron Partridge punt - fumble
09.21.2013 FCS Cornell Bucknell 2 4-53 Cor 13 0-10 Chris Fraser punts - penalties, sack
09.12.2009 FBS New Hampshire (FCS) Ball St. 3 3-51 NH 49 23-9 RJ Toman rush; punt on 4th 7 started 1&goal @ BS 10; 2 penalties, fumble, penalty
10.25.2014 D2 Bowie St. Virginia Union 1 4-51 VSU 32 0-0 Rush for loss of 25 to V45, fumble, VSU recoved at V32 - fumble
09.12.2015 FBS BYU Boise St 2 4-51 BYU 11 7-7 Johnny Linehan punts -
12.23.2005 FBS Kansas Houston 4 3-49 Kan 16 42-13 Brian Luke pass complete to Marcus Henry; punt on 4th 16 5 penalties
10.08.2011 FBS Texas Oklahoma 3 4-49 Tex 47 10-48 Justin Tucker punt - no panalties
11.22.2008 FBS Notre Dame Syracuse 3 2-47 ND 40 13-10 Claussen pass complete to Grimes; incomplete on 3rd; punt on 4th 7 penalty, sack, penalty
11.19.2005 FBS Duke UNC 2 3-46 Duke 25 14-14 QB draw -1 yard; then punt on 4th - fumble, penalty, sack
10.15.2016 FBS Army Lafayette 2 2-44 Army 30 35-7 Two incompletions followed by lost fumble on fake punt. - fumble, penalties
09.05.2015 NAIA/D2 Edward Waters College Morehouse 2 3-44 MHC 46 0-17 Sir Jackson pass incomplete to Ray Dukes. (punt on 4th) - errors statistician corrected
11.25.1989 FBS U Miami Notre Dame 3 3-44 Mia 7 10-17 Craig Erickson pass to Randall Hill 45
10.21.2006 FBS Indiana Ohio St. 2 4-43 Ind 18 3-21 Tyson Beatie punts - sack,sack+penalty
11.30.2013 FBS Kansas State Kansas 3 1-42 KS 40 21-10 Jake Walters rush 5
11.14.2015 FBS Georgia Auburn 4 3-41 UGA 25 10-10 Brendan Douglas rush 20
11.06.2014 FCS Miss Valley St. Grambling 4 4-37 50 23-38 Scott, D. pass incomplete to Stafford, J. -
In the collegiate game we witness feral athleticism, schematic diversity, and late-game trepidation. We also encounter gaudy futility. You can watch the Northwestern state offense penalize itself into a 3rd and 61 hole, here, or watch Miami overcome 3rd and 44, here. Although absent from Table 2, the 2014 Wake Forest offense is worth noting. Be it personnel, unpreparedness, ineffective schematics, or some combination thereof, the Wake Forest offense was startlingly inept. It surrendered 19, 19, and 18 tackles for losses in games against Utah St., Virginia Tech, and Clemson, respectively.

In this post, I attempted to provide a comprehensive sampling of lengthy down-and-distance situations representing all levels of football. I excluded high school football. Were you interested, you could probably unearth evidence of a 4th and 79 or similar adolescent absurdity. However, I was unable to verify any D3 down-and-distance situations but also I only searched for those > 60-yards to go. Surely such dire situations have occurred. In Table 3 below below appears a small sampling of outrageous—but illegitimate—down-and-distance situations found in D3 and elsewhere. 



Table 3. Sampling of Illegitimate Lengthy Down and Distance Situations
Date Division Team Opponent Down Notes
09.07.2013 D3 Washington U. UW-Whitewater 4-89 Probably due to reporting error. Also error of 2nd and 64 in PbP.
09.21.2013 D3 Frankling & Marshal Ursinus 2-81 Probably due to reporting error. Also error of 2nd and 68 in PbP.
09.21.2013 D3 Amherst Hamilton 3-75 Probably due to reporting error.
09.07.2013 FCS Central Connecticut Leigh 2-71 Probably due to reporting error.
09.28.2013 D3 Wilmington Heidelberg 2-67 Probably due to reporting error.
09.06.2014 D2 Fayetteville State Chowan 4-66 Probably due to reporting error.
09.21.2013 D3 Wilmington Otterbein 3-65 Probably due to error related to field position and penalty assessed on kickoff.
09.13.2014 D2 Lane College Clark Atlanta 2-64 Probably due to error in reporting start of drive. Should be LAN13 but was CAU35
09.12.2015 D3 Wisconson-Eau Claire Concordia-Moorhead 4-60 Probably due to error in computing of field position following interception.
09.19.2015 D3 Muskingum Mount Union 4-59 Probably should have been 4th and 17 due to fumble and penalties on punt.
1Although I uncovered an original source, I must credit Gary Peterson for unknowingly providing insight.

Monday, October 19, 2015

Approximating the Yardage Value of a Pass Deflection in the Aggregate

Rich Sherman administers a critical pass deflection.
As adumbrated in the previous post, I wanted to quantify the yardage value of a pass deflection (PD). I will wait to consider the effect of team defense and special teams in a future post. I apologize to readers anxiously awaiting that analysis.

A PD occurs when a defender deflects a pass or dislodges a to-be-caught ball from the grasp of a receiver or otherwise actively prevents a reception (without penalty). A PD is a productive play for the defense and an unproductive play for the offense. There is a caveat to that, however: a PD on 1st, 2nd, or 3rd down is diminutively productive for the offense in that it ensures another down (i.e., no turnover).

There is no progress in obtaining a 1st down on the down in which a PD occurs. Likewise, a PD reduces by 1 the quantity of downs available to the offense. Ultimately, a PD indefinitely results in zero yards gained offensively or allowed defensively. Because of this, established per-pass or -attempt values such as Y/C-, Y/A- or N/YA-allowed would be inaccurate because those values are calculated using yardage of offensively productive passes (i.e., yardage incurred on plays generating 1st downs and TDs).

Concretely, a down of zero gain yields a yardage value of zero, duh. Abstractly, the yardage value of a down with zero gain—and thus, the yardage value of a PD—varies depending upon context, of course. Game importance, game score, down, and the yards needed to secure another 1st down are each salient.  So, for me, the dilemma entailed identifying a team-specific, discrete yardage value that, in the aggregate, accurately represents a PD.

Additional complexities arise because a PD is but one of many unproductive—or less than optimally productive—offensive passing outcomes. First quarter, tie game, 3rd and 10 at their own 20, for example, the QB hits his targeted WR on a bubble. As the WR secures the ball he is tackled harmlessly for a gain of zero. The play was unproductive because the team fails to secure a 1st down. Consider the same 3rd and 10 but instead, the QB successfully passes to the WR for a gain of 8. The offense fails to secure a 1st down and punts away possession. Although this second example is also unproductive, it is marginally more productive than the first example-play because the 8-yard gain conceivably reduces the opponent’s starting position. Thus, we need to quantify unproductiveness.

Metrics judiciously more refined and discriminative than anything you’ll probably ever read about on POTH provide some insight. For instance, Football Outsiders have identified expectations of offensive success. An offense shall accrue 45%, 60%, or 100% of needed yards on 1st, 2nd, or 3rd down, respectively. On 1st and 10, then, an offense ought to gain at least 4.5 yards  for a play to be considered productive; for 2nd and X, 60% of X; and for 3rd and X, at least X yards. With this model then, offensive unproductiveness is the failure to obtain those thresholds and the PD-yards value should, given my definition, be equivalent to the average yards allowed on unproductive pass plays. Readily obtainable via the publicly available play-by-play data (here and here) are the yards generated on unproductive completions.

To review, we are obtaining 6 summative data points per team per season: 

    • quantity of completions of <50% yards to go on 1st down and the
    • quantity of yards accumulated therein; 
    • completions of <60% yards to go on 2nd down and the 
    • accumulated yards; and
    • completions of <X yards to go on 3rd and X and the
    • yards on 3rd and X.
      I’d like to add that I considered using the difference of unproductive yards and yards to go as a measure in the computation of PD yards. My suspicion was that that difference would yield larger values for defenses that limited offensive opponents' progress and forced longer ‘yards to go’ situations, thus larger values would reflect better defensive play. However, I decided against this because cursory analysis disconfirmed my suspicions.

      Table 1. Descriptive statistics for average yards allowed per unproductive completion by team defenses, 2010-2014.

      I obtained the data points described above for all NFL teams in the 2010 through 2014 regular seasons. Table 1 contains some descriptive stats for the average yards allowed per unproductive completion per team defense. Across seasons, the 2013 Buffalo Bills were lowest and the 2011 NY were highest. Across all seasons, there is slightly significant kurtosis and minute skewness but, with the exception of 2013, each individual season is normally distributed. Additional statistical procedures reveal that the effect of PD yards on starting position is almost entirely attributable to the action of PDs and not unproductive yardage.1


      I could discuss the weaknesses of this approach of quantifying PD yards but I really don’t feel like it. Instead, I provide an anecdote in the following paragraph providing some perspective on the notion of productivity. Likewise, I provide a table at the close of the post which displays the simple correlations of PD yards. Aside from developing a method of quantifying PD yards for the purposes of appraising defensive backs’ influence on their teams’ offensive starting positions, I am intrigued by the concept of unproductive yardage. A topic for future posts, indeed.


      Rob Bironas celebrates.
      It is worth noting that a completion could be productive without satisfying the stated productivity criteria. Late in the 4th quarter, December 3 2006, the ball sat on the Colt's 46-yard line. First and 15, Titans’ center Kevin Mawae hiked the ball to Vince Young. Young dropped back and completed a pass over the middle to Travis Henry for an unproductive 4 yards. The Titans shuffled to the line and Young spiked the ball with 15 seconds remaining. Young tossed an incomplete pass on the following play from scrimmage. Fourth and 11, enter Titans’ Rob Bironas who kicked a 60-yard field goal, granting the Titans a 20-17  lead and securing a victory.  Bironas kicked 70% from 50+ yards in his career (24 of 34) but was 1 of 4 kicks of 60+ yards; that 60-yard, game-clinching kick was the longest of his career.  To make apposite of my digression, were Young’s pass to Henry deflected—assuming zero yards were gained on any subsequent play(s)—perhaps Bironas would have missed a 64-yard attempt.  

      Table 2. Correlations of Approximated Pass Deflection Yards and Pass Deflections with various variables across team defenses, 2010-2014.

      1Let us verify that PD yards influence field position independently of the effect of the yards allowed on unproductive passes. To do so we regress offensive (of the defensive team) average drive start positions onto unproductive yards and obtain residual values. We regress those residual values onto PD yards and find an infinitesimal decrease in the R2 of drive start on PD yards, from .10 to .08 when controlling for quantity of unproductive pass yardage. Let us then regress average drive start onto the quantities of PDs, obtain residuals, and regress those on PD yardage. Our R2 is essentially zero.