Once you enter the area, head to the back walls until the Colossus breaks the walls (or you can climb up and over them). You have to do this 3 times until you reach an area where you can hide under a section with pillars.
Shoot the hands of the Colossus until he reaches down to look for you and jump on his hand/beard.
His weak spots are on his head and his back.