You can clear all selection areas off the map at once by using the Clear Selection Area tool. To use this tool, click the arrow next to Select in the map tool bar.

Click Clear All under Clear Selection Area.

All selection areas will be cleared.

Tip: If you want to delete specific selections, use the Delete tool.