COVID-driven isolation is 'lonely existence' for family, as man says he's been 'abused' for mask wearing