1. Check the Service Resource OWD. If it is private, make sure the affected users have access to the records.
2. Next, check whether Active check box is enabled on the Service Resource record.
Offline Agents are unavailable in the Agent Summary of Salesforce Omni-Supervisor