You can deactivate a single group by clicking on the “ellipses” against the group which you wish to deactivate.
1. Clicking on the ellipses would open the options drawer
2. You can now see a new option “Deactivate all calendars in group”
3. Clicking on which would show a pop-up requesting confirmation
