Slice the potatoes into two and put them into a large stockpot or a large saucepan.
Add enough water to submerge the potatoes.
Add in the garlic, bay leaves, rosemary, and salt; stir until well combined.
Place the pot or pan on the stove and turn the heat to medium; bring to a boil for about 2 to 5 minutes; allow the water to boil for 5 minutes more.
Drain the potatoes and allow them to dry at room temperature.
Pre-heat oven to 375°F.
Line a baking sheet with aluminum foil.
Put the potatoes back in the pot or pan; add cayenne pepper and oil; rub the potatoes until well coated.
Arrange the potatoes in the prepared baking sheet, cut side down.
Sprinkle the potatoes with salt, to taste.
Place the potatoes inside the pre-heated oven and bake for 35 to 40 minutes or until done; the potatoes should be super tender.
Remove from the oven and serve immediately.