Sure! You can set it like this, in your ~/.byobu/.tmux.conf
:
set -g window-status-activity-bg red
For a complete list of color options, refer to tmux.1 and specifically its OPTIONS
section
Full disclosure: I am the author and maintainer of Byobu.