Those close to Mr. Obama say he grows irritated at being misunderstood - not just by opponents who insinuate that he caters to African-Americans, but also by black lawmakers and intellectuals who fault him for not making his presidency an all-out assault on racial disparity.