Fix readdir race condition with concurrent deletions

Fix readdir race condition with concurrent deletions #4583