Various bugfixes - #3623

The socket cleanup that runs after forkfile exits could delete the
socket of a newly spawned forkfile, as the new listener is created
before the old cleanup completes. Only remove the socket if it's
still the one we created.

Signed-off-by: Stéphane Graber <stgraber@stgraber.org>