We have recently shown ipsilateral dynamic deficits in trajectory control are present in left hemisphere damaged (LHD) patients with paresis, as evidenced by impaired modulation of torque amplitude as response amplitude increases. The purpose of the current study is to determine if these ipsilateral deficits are more common with contralateral hemiparesis and greater damage to the motor system, as evidenced by structural imaging. Three groups of right-handed subjects (healthy controls, LHD stroke patients with and without upper extremity paresis) performed single-joint elbow movements of varying amplitudes with their left arm in the left hemispace. Only the paretic group demonstrated dynamic deficits characterized by decreased modulation of peak torque (reflected by peak acceleration changes) as response amplitude increased. These results could not be attributed to lesion volume or peak velocity as neither variable differed across the groups. However, the paretic group had damage to a larger number of areas within the motor system than the non-paretic group suggesting that such damage increases the probability of ipsilesional deficits in dynamic control for modulating torque amplitude after left hemisphere damage.