As part of the general clean up after this morning's pheno crisis, I cleaned out stuck gatekeeper processes on the cluster. There were about 50 of these processes, which were all in "T" state. This is "traced or stopped", and I presume stopped actually, as nothing would be tracing them. Most of them has an associated child in zombie state.
Wonder why that happens?