First off make sure you have a knife equipped, either just the knife or a knife/pistol combo.
Sneak up behind a guard, let go off the left stick and press and hold the circle button. Snake will grab the guard and by holding down circle he'll slit their throat.
Remember to reload your game if you're doing a no-kill run for the Peace Walker trophy.