This fight you will be riding Agro a lot.
You need to hit the Colossus in the glowing red eyes, this will cause it to crash into a wall where you can damage its weak spot.
Try and get in a straight line so it is easier to hit the eyes as both you and the target will be moving.
Once he crashes climb on his back and hit the weak spot and repeat until he is defeated.