I'm wondering how do I get Concrete blocks, those who are made by smelting the gravel, I see them on multiple videos online but don't have the opportuinty to get them on my world. Please help me!

That's called brownstone now, since concrete was added by vanilla.