You might want to walk through the C++ tutorial on this site. It is really good.
Don't worry too much about libraries just yet. The standard language provides all kinds of stuff for you already. When you find that you
do need an external library you'll be ready to figure it out.
But, for the impatient:
The general purpose of a library is to provide additional code that you can reuse without having to write it yourself.
For example, suppose you want to write OpenGL games. You will need to get the libraries for programming with OpenGL so that you can use its predefined functions to initialize the window and load images and define geometry and colors etc, instead of having to reinvent the wheel yourself.
(And if you really do want to play with OpenGL, visit
http://nehe.gamedev.net/ for tutorials on how to get set up with all the correct libraries and how to start writing stuff...)
Welcome to C++ land. Try to keep your sanity. :-P