Unless you did the little sidequest to gain the option to spare the Outsider, killing him will be the only option at the end of the game. Otherwise, you'll get to choose.
So, basically, just reach the end of the game and make the choice to kill him (by walking up to him and pressing