The Colonel had a strong and vocal dislike of KFC. He would walk into franchises and criticise the food that does come out.
One has to imagine he was not popular then.
One has to imagine that he had a legacy and future in mind.
And what we remember him for now, could not have been it.