Starting a village from scratch? Wrangling villagers is a pain, let them come to you.
Craft a "Help Wanted" sign and there will be a small chance every morning an unemployed villager will come to your settlement. If you don't want to wait, place an emerald (or gold/diamond) block next to the sign and someone will gladly take it soon.
Recipes: