I think this is a good way to picture an Average Joe in the yukkuri world. depending of their mood thye may beat the crap of yukkuris until they are dead for bothering them or attacking them, or they may beat them up a bit and kick them out still alive.
I dunno. I'm an average human, but I tend to favor the more benevolent/magnanimous side.
I'd probably have talked to them. They didn't do a home invasion, and Mister Human had a hard time noticing them -- that means they're trying not to be a nuisance.