Best library for video processing?

[unixhand]

I want to do write a program that does some video and image processing. For example, find patterns in a image, like similar color of pixels in adjacent squares, or locate the moving object in a video, etc. What is the best library to use for this? I was thinking OpenCV. Does anyone here have experience using OpenCV with C++ or C++ with some other vision library? Thanks.