If you taking a break bothers someone tell them you're going to replace their carpet with Legos.
Self-care is important and working while you need it will only result in a worse outcome, for both yourself and what you're working on.