Exceptional weapons don't always appear exceptional stat-wise, but will have Orange names regardless. Once picked up you have credit for it, so feel free to drop or sell it at that point. Finding these weapons is completely random, though you can get the Scavenger skill for Logan or Jackpot for Purna (in the Survival skill tree) that will increase your chance for better loot. The other two characters do not have a similar skill. These can be looted from chests or dead zombies, doesn't matter