there're a couple cat fish ponds at the nature center in Kinston. After a day of fishing, you can also bring the boys to the nearby Neuse Sport Shop to check out the stripers, LM and white cat fish they have in the tank.
Or you can also travel further east to New Bern, I've seen ppl bank fishing the trent and crabbing at lawson creek park.