Hi ,
I am reading 3 million rows (three 1 million rows in parallel) from DB at one go and writing into three xlsx files in the same parallel thread using Aspose.LightCells.
However, sometimes the application is throwing System Out of Memory exception when having so much of data in the memory.
This is happening when the main assembly is running under “AnyCPU” in x64 machine, but on changing that to “x64” explicitly things started working fine.
So we want to change our approach to avoid such exceptions. Our idea is for 1 parallel execution if we get 1 million rows in chunks like 200K rows 5 times from DB and write into the same xlsx file.
I tried with merging which took more than an hour to generate 1 xlsx file.
So what is the best way to write 1 milllion rows in a single xlsx file in chunks?