Hm... If you open up the taskmanager and terminate the window, Explorer will do a full restart, most of the time closing all windows. Just warning you.
Oh and how many files do you have in that folder? If there's LOTS (and I mean a few 100 files) in there it may take a big while to load.