"I’m all for improving diversity in housing stock," said Denny Swenson, a long-time Milton resident who previously served on the town's planning committee. "I welcome it, I love to see it.