Each road has a speed limit. So, use your best judgement as to which ones to upgrade. I have no proof it effects your population growth.
Just deleting roads to resources and factories is not enough for me. I also have to make a new longer broken path, roads seem to grow back. But if you make a long broken path, it works. That is one of the 1st things I do, rearrange the roads to my liking.