Pi Musicbox volume control (for Amp hat) not working with Spotify Connect

Yes, sure I can change the volume from the Spotify Connect app, but is that not only the input volume ?
I have to set it to 2% to avoid blowing the speakers. For that reason I would like to reduce the Amp hat volume.