From the beaches to the Broadkill River, the number of people moving to or visiting Milton is growing.