Chrome shows vertical scrollbar at the right side when using direction:rtl
This is a known webkit bug. The scroll will render on the right in Safari, as well.
There's an answer here that has several different workarounds, including the jQuery plugin jScrollPane and a native-looking hack.