you are right.
cars without power steering have radically different steering gears than those with. When your power steering fails, you are fighting against the power mechanism. It's not at all analogous to manual steering. My mid-80's ford pickup had no power assist in the steering.