Should I speak to all the group interviewers -- even if they are not asking questions?

If any of the group members appear withdrawn from the process, make a couple of attempts to draw them out by asking them about their role or position. If they resist, let them sit back and focus your attention on other construction interviewers.