Trump tried to make allies of fishermen. Some are turning on him