Vim: Can't exit Visual Mode using jk (Arpeggio Chord)

Vim: Can't exit Visual Mode using jk (Arpeggio Chord)

I use Arpeggio to map jk to ESC So when I press jk simultaneously I can
exit to normal mode very quickly.
I found this trick from Arpeggio plugin page
This is what I put in .vimrc
Arpeggio inoremap jk <ESC>
Exiting from Insert mode works perfectly, But I can not exit from Visual
Mode. It would be nice if I can exit both mode so I can stick with this
key, It save my time a lot.
Any idea?