The problem probably comes from the screen recording (The detector fps can't go above the record fps). It's a very simple thread that just use the DXGI desktop duplication and it should request nearly 5% cpu/gpu power. I plan to test a new way to get the screen data for the next update so maybe it will fix your problem.
You can confirm this by setting the Max FPS of bodies detection to 1 and the recording fps should still drop the same.
I don't know why this happen to you (trebor and wombatant). Do you use a gsync screen ? Also, do you know if you reach 60 fps when you record the entire 4k monitor with OBS with the DXGI Capture method ?