Cannot Parse Large CSV Files

[Taffywaffy]

I found this snippet online and have been using it for years. It converts CSV files to string arrays. It works fine for "small" csv files, but will not convert larger ones. Large being 5000+ lines or ~750k size. It just exits the code without errors or string array. I wish to input larger files, how do I do that?

istream& operator >> ( istream& ins, record_t& record );
istream& operator >> ( istream& ins, data_t& general );


int main (int argc,char *argv[]) {

    ifstream decodefile;
    decodefile.open("myFile.csv");

    data_t general;
    decodefile >> general;
    decodefile.close();

 return 0;
}


istream& operator >> ( istream& ins, record_t& record )
  {
  record.clear();
  string line;
  getline( ins, line );

  stringstream ss( line );
  string field;
  while (getline( ss, field, ',' ))
    {
    stringstream fs( field );
    double f = 0.0;
    fs >> f;
    record.push_back( f );
    globalint++;
    }
  return ins;
  }

istream& operator >> ( istream& ins, data_t& general )
  {
  general.clear();
  int g=0;

  record_t record;
  while (ins >> record)
    {
      g++;
      general.push_back( record );
    }
  return ins;
  }

[jonnin]

Have you recompiled it? If its been around for years, it could just have a smaller memory model? I don't see anything that would limit it here, at a glance.

the files you mention fit in memory effortlessly on a modern machine...

[jlb]

What is a record_t and data_t? It would be easier to see what if anything is wrong if you posted a small complete program that illustrates your problem.

Please post a small sample of your input file.

[Taffywaffy]

I recompiled the code to the latest g++ compiler. It did the trick! Thanks