That is not a scroll bar, that is the fringe. You can control it by customizing the fringe-mode
variable. If you don't want to do that manually, do M-x customize-variable
RET fringe-mode
RET, choose "No fringes" from the Value Menu and save.
More info about window fringes here.