Only three weeks into the season, Notre Dame and Clemson have dropped out of the playoff picture with two losses each.