Ah... hehehe. I had this problem once and I hated IOstreams for a while when I discovered it. But, I'm over it now. :)
The copy constructors on most if not all the streams are protected, and I think so are the default assignment operators. That means that you cannot use push_back() with them. You are not meant to copy streams, and you may have quite some difficulty doing anything that might involve their copying. Sorry.
How about storing the file names instead of ifstreams?