You can uninstall FEBE by clicking Tools > Add-ons, find the entry for FEBE, click once to open it and then click "Uninstall".
There is a way to have FEBE backup only once a month and another option to not display the report at all. These options can be found in Tools > FEBE > FEBE Options.