Unlike most of the other parts, installing chest attachments requires that you push them all the way through a slot so that they lock in place properly.

To uninstall a chest-area attachment, first detach the "section at the figure's neck (circled above), by pulling it forward.

(The picture illustrates changing from standard to battle
attachments)