I've went over it in my mind, and i think it has to be Abraham. That's the only person I can think of who will be missed, but losing the character won't totally break down the core of the show
Of course, I never in a million years would have thought Beth would be killed off ! Or Hershel!