Shall we place you here visiting relatives? In fact, your family could have had Brotherhood ties, and, when approached by the Crooked Stile, you saw it as an opportunity to piss them off. (Pissing off your family was already in your background.)
We could say that the people you're visiting now are not your immediate family, but one of a long string of relatives whose hospitality you've abused and taken advantage of.
Does any of this sound good?