I really dislike
the pop-up scroll bars on Ubuntu. This is how you turn
them off:
12.04 and before
gsettings set org.gnome.desktop.interface ubuntu-overlay-scrollbars false
12.10 and after
gsettings set com.canonical.desktop.interface scrollbar-mode normal
Ubuntu:scrollbars is mentioned on: Linux