There aren't a lot of Inquisition agents in Haven, but there are enough to handle this: someone up the chain has ordered that all the "people" who came through the rift are to be brought back to Skyhold. The air quotes aren't subtle, and neither are the stares that follow them around Haven's barebones camp and up the road into the Frostbacks. Sure, they have marks that look like the Herald's, but who's to say they aren't just some new sort of demon, or worse? Hopefully someone in Skyhold can make sense of it, and nobody is clapping them in irons just yet, but in the meantime suspicion is unavoidable.