Yes: you can only use it to speed up compilation of code that won't change often (e.g. finished code). Every time code included in the precompiled header changes, the PCH has to be recompiled, and anyone who includes it will also have to be recompiled, obviously.
But if you don't need to keep touching the headers, then by all means include them all in a single PCH and include that in every source file.
Precompiled headers don't get rebuilt, so your build won't know that you changed them.
Yes, they don't get rebuilt (this option ignores them) but my wxDev-C++ IDE (with the MinGW compiler) knows when I changed something in that kind of header and MinGW builds it again...
I don't even have to delete my header.h.pch file...