Did you know this about the fish:
Studies have shown that fish who are hooked and thrown back are so traumatized that many die from the experience. The pain of being hooked in the mouth is excruciating—Thomas Hopkins, professor of marine science at the University of Alabama, has compared it to “dentistry without Novocain, drilling into exposed nerves".
"Sylvia Earle, former chief scientist of the U.S. National Oceanic and Atmospheric Administration, has written, “[Fish] are our fellow citizens with scales and fins. . . . I would never eat anyone I know personally. I wouldn’t deliberately eat a grouper any more than I’d eat a cocker spaniel. They’re so good-natured, so curious. You know, fish are sensitive, they have personalities, they hurt when they’re wounded.”
Not that it should matter whether an animal is 'good-natured', curious, sensitive, have "a personality" as we define it, etc. in order for him/her not to be exploited.
More to learn
If you don't want to harm a sentient being with a desire not to be harmed.
If you don't want to kill a sentient being with a desire to live.
If you don't want to exploit a sentient being with an interest of living. Then, go vegan.
Is it right to disregard the fundamental rights of other sentient beings to satisfy our most trivial interest of pleasure or convenience?
If you answer 'No'. Then the only rational choice is to go vegan.