With a multimap it would be faster, but with map<>, count() returns 0 or 1 so I think the speed is comparable. It might even be faster since you don't have to do the check against end().
But the point about readability trumps any possible small performance gain. Checking find() != end() will work with most (all?) collections so it's what a reader would expect to see.