Any blocks count towards this (dirt, stone, etc). You can mine them by hitting them with your weapon, fist or a tool. The better the tool you use, the quicker you will mine them.
If you gather some wood from a tree and 4 stone blocks, you can craft a stone pickaxe which will make it quicker to mine stone blocks.