It sounds like he thinks the meeting room is a highschool classroom. Not appropriate. You were all adults in the room and if the task was completed then I don't see why he has a problem with you interacting with a colleague.