Physical strength aided by ki?

[Orion]

With our current system, it's possible for someone to not use ki at all and just be a fighting powerhouse. However, I thought of something that needs clarification.

If I choose someone who uses ki as well as fighting, would that give me stronger hits and take less damage than someone who doesn't use ki?

Ie. A Z fighter could punch through a brick wall with his bare fist and not feel it, whereas someone who knows nothing about ki would end up with a broken fist.