I agree with you, but there is no shortage of anecdotal claims to the contrary.
Rear stabilizer bar (i.e. anti-roll bar) stiffness can affect straight-line handling by changing the suspension's response to road surface irregularities ... e.g. a stiffer bar will increase bump/roll coupling.