Follow these steps:
1. Download a utility called "Close All" from here .(Size: 1 MB)
2. Just install the software.
3. Pin the application to taskbar by just dragging the application to the taskbar (for easy access)
If you want to close all apps in one click just click on the icon in your taskbar or open the app.