Voice assistant

Hi... I'm facing an issue where the long press of the middle button just opens the assistant on the phone but does not really connect and act as a phone...the connection gets failed. I'm using a Samsung z fold and this is happening with whatever assistant I choose...google, bixby or gemini