Maybe it's because dwarf used not regulars skill but armor crush on you ? Try on coloseum or some arena if this skill working on normal regular physical hits, and after that try it when opponent uses skils (even physical).
I don't know is it bug or not, but some skills like this working for example only on regular hits, and not on skills.