The visitors started well and were always a step ahead after Jamie Vardy headed home for 1-0 inside four minutes.
Harry Kane levelled, Riyad Mahrez put the Foxes 2-1 up and we had it all to do when Kelechi Iheanacho rifled home for 3-1 two minutes into the second half.
Erik Lamela led the revival, twice linking up with Kyle Walker-Peters and forcing an own goal after 49, 53 and 60 minutes to put us 4-3 up only for Leicester to hit back again as Vardy fired home from the angle for 4-4 on 73 minutes.
It was time for Harry to step up again.