I think I have found what's causing the bug. I've assigned "a" and "d" keys for quick brush size increase/decrease. And so when I use a custom brush, exit it to use the regular brush, and then increase/decrease size the custom brush opens back up
It happens even if I close the Brush Manager Pro window for some reason