My grandfather had a membership to Camp Bryan, which is on Ellis Simon Lake in the Croatan Forest. It was passed to my father, but after the duck hunting and fishing got tough there he decided it wasn't worth the yearly cost. Thus, I grew up fishing Ellis Simon lake and it was the source of some of my fondest memories of bass fishing with my Dad.
This was 30 years ago, but I recall the word about Great Lake and Little Lake being that they weren't worth fishing. I don't know if that's changed but whatever factors were involved with the habitat I would guess have not changed much. Lake Simon last I heard was inundated with hydrylla and very difficult to fish anymore.