I think fishing naturally will not make their population die.

What makes the fish die is the people who catch them heavily using modern equipment and / or poison.

I do not agree with that either. :)