Yep. That is why Domovoi are limited in extent. Otherwise he could literally, at a certain level of power, tell the spirits of the school's walls to collapse themselves on everyone.
The last time one Domovoi was removed in limits, he basically had to be dogpiled with serious magical shit before he stopped, and they had to gag the fucker while he tried to shiv them.
Well, if it's just charisma and negotiation skill, can't he just focus on that? Hell, I had a type of pseudo-eldritch entity in a setting of mine that literally negotiates so effectively that anyone too close to it would quickly find that they have been convinced to make legally binding agreements that screw themselves over without even remembering signing them.
Physical limitation. He CAN'T do it, not without some very powerful being breaking that limit off of him.