Project Explorer changes selected item before deletion

When selecting an item in the Project Explorer and attempting to delete it (via Delete key or context menu) as soon as the "Remove File" dialog pops up the selection in the Project Explorer changes Either to another opened file in the current session or to the one above the selected file in the Project Explorer.
This is confusing for the user especially if the user decides to cancel the deletion the new selected item stays selected.