Bladesinger: The high INT would help with both Swashbuckler and Bladesinger, but I'm not sure the flavor of Bladesinger really fits with the character
Dervish: I really like this idea, and have found a lot of pictures of pirates wielding scimitars. The problem with this, is that you can't use weapon finesse with a Scimitar until you make it to Devish. So either I waste Weapon Finesse and use a scimitar, or I waste a feat to take Weapon Focus (required for Dervish) on a weapon I won't be using for awhile. If there were a feat that allowed Weapon Finesse on a slashing weapon (besides spiked chain) that might solve the problem.
Dread Pirate or Duelist: Just not interested in these classes at all.
I'm not an optimizer, flavor is definitely more important to me than power. Anyone have any ideas?