Agent Avatar image in Static Resource:

Store the Avatar image in Salesforce Static Resource.

Set the URL in embedded_svc.settings.avatarImgURL to set avatar image to the Embedded Chat in Salesforce.

Sample Code:

embedded_svc.settings.avatarImgURL = 'URL_Of_The_Image';

Output with Agent Avatar: