Cancel should be tied to activation when the Esc key is pressed. The action when this occurs is the Color chooser unposts.

If default action functionality can't or won't be provided it should provide a mnemonic to allow fast activation. The lable needs to indicate which letter is the mnemonic.