Losing late goals

Of the 15 (yes, 15) goals we have conceded in the league so far this season, 11 of them have been lost in the last quarter of the match.

Are we just not fit enough? Or is there something else?