Unlink shutdown callback from ref count #2483

Job	Run time
clang-sanitizers (,thread)	2m 41s
downstream	4m 13s
clang-sanitizers (,address,undefined)	2m 20s
linux-compat (manylinux1-x64)	1m 14s
linux-compiler-compat (clang-3)	2m 0s
linux-compat (manylinux1-x86)	1m 23s
linux-compiler-compat (clang-6)	6m 9s
linux-compat (manylinux2014-x64)	1m 28s
linux-compiler-compat (clang-8)	6m 33s
linux-compat (manylinux2014-x86)	1m 22s
linux-compiler-compat (clang-9)	6m 12s
linux-compat (raspbian-bullseye)	6m 55s
linux-compiler-compat (clang-10)	1m 52s
linux-no-cpu-extensions	1m 37s
linux-compat (fedora-34-x64)	1m 17s
linux-compiler-compat (clang-11)	2m 2s
linux-compat (opensuse-leap)	1m 38s
linux-compiler-compat (gcc-4.8)	1m 27s
linux-compat (rhel8-x64)	1m 13s
linux-compiler-compat (gcc-5)	1m 37s
linux-shared-libs	1m 39s
linux-compat (al2-x64)	1m 12s
linux-compiler-compat (gcc-6)	1m 40s
linux-compiler-compat (gcc-7)	1m 45s
windows	2m 28s
windows-no-cpu-extensions	2m 16s
linux-compiler-compat (gcc-8)	1m 58s
linux-compiler-compat (gcc-11)	1m 48s
windows-vc14 (x86)	1m 37s
windows-vc15 (x86)	2m 34s
windows-vc14 (x64)	1m 45s
windows-vc15 (x64)	2m 30s
windows-vc16 (x86)	2m 34s
windows-vc16 (x64)	2m 50s
Cross Compile linux-armv6	1m 54s
freebsd	9m 33s
Cross Compile linux-armv7	2m 5s
macos	1m 37s
Cross Compile linux-arm64	1m 47s
Cross Compile android-armv7	2m 16s
macos-no-cpu-extensions	1m 32s
macos-x64	2m 43s
openbsd	11m 38s
windows-app-verifier	23m 2s
windows-shared-libs	2m 27s
linux-debug	1m 34s
macos-debug	1m 26s
windows-debug	2m 32s
	2h 29m 55s

Provide feedback