Is fp series' HDMI output and USB connection possible even with the ELECTRONIC VIEWFINDER EVF-11 attached?

You need to remove the EVF-11 to use the HDMI output.
Recording to an external SSD is possible by using the SSD dedicated terminal on the side of the EVF-11.