You can clear Internet Explorer's cache, found in your Internet Options under the Tools menu, to improve browser performance.
You can easily delete a notebook in OneNote when you no longer need it by accessing File Explorer and removing it there.