Goldsmithing is located in Ul'dah. Speak with the Guildmaster, you can find them on the minimap under the Goldsmiths Guild. They will give you a quest that teaches you how to synthesize your first item.
You can purchase more supplies from the Guild Supplier merchant in the same room as this if needed.
You can repeat this process 999 more times to unlock :