Is there a way to permanently close/delete/remove the shoutbox from my sidebar?

you need to go to personal tab > user dashboard > side bar. or just click here. then you just click the x to remove any widget you don't want from the "Your Widgets" section.

Thank you ! ^_^