Seafood industry to lose over 4,000 foreign workers