Massive Data Load

Hi!

Our application works with massive Task data (near 12K tasks and 20k Task links). Due to the data volume, it takes a lot of time to load it in a Aspose.Tasks project (at a moment, more than half hour for a single task link). Is there a way to load these data just validating task links without updating dates until the end of the data load to execute only one project recalculation? I know that it’s a heavy process (even MS Project takes 15 minutes to open the final generated file), but this is very important to the application.

Thanks in advance,
Dalton.

Hi Dalton,


We have tested Aspose.Tasks with over 5K Tasks (though there were no task links) and the file was loaded swiftly without delays. I may discuss this with our development team but if you could please elaborate your requirements, it will help us give a thorough investigation into this issue and assist you further.

Hi, Kashif.



I am attaching the resulting Project file from one of our planning system (the predecessors were added manually due to the performance problem I told). It loads really fast but the recalculation expends A LOT of time due to the complex predecessors logical structure. Our problem can be simulated following these steps:

1 - Load the Project file in a Project class instance;
2 - Create a new Project class instance;
3 - Read all Tasks from original project and create a new instance for each one in the new project;
4 - Read all TaskLinks from original project and create a new instance for each one in the new project (here the problem happens);

Thanks in advance.
Dalton


Hi Dalton,


Sorry for a delayed response. I am currently investigating this issue and will soon share my findings here with you. Your patience is highly appreciated in this regard.

Hi Dalton,


I have analyzed the requirement again and found a function which copies all the tasks, task links, calendars, resources etc. to newly created project. Could you please give a try to the following code which copies a project to a blank template project file and saves it to disc?

Project original = new Project(@“eap.mpp”);
Project blankMpp = new Project(@“Blank2010.mpp”);
original.CopyTo(blankMpp);
blankMpp.Save(@“new.mpp”, SaveFileFormat.MPP);

Following are the statistics for the above mentioned code:
  • Time to load eap.mpp is 41seconds.
  • Time to load blank Mpp is 0 seconds.
  • Time to copy the original project to blank template file is 0 seconds.
  • Time to save the newly created project = 154 seconds.
If this does not fulfill your requirement, please elaborate the requirement to copy tasks and links manually. Also send us the standalone console application which can be used to re-produce the issue here as it will help us to analyze problem in detail and provide you assistance in a better way.

Hi Kashif,


I think I was not so clear with the issue.

The problem occours when we load these data from our database. The attached Project file is the final result from loading data from DB and replicating them into Aspose.Tasks structure. The Tasks and calendars structure load are very fast. The problem begins when we add the dependencies/predecessors. At a point, it takes 12 hours to add a single dependency. This is the point. Anyway, if you call the Task.Recalculate method using the root task as parameter in the loaded/copied project in your sample, it will expend A LOT of time. Follow attached a sample to reproduce it. Update file paths in source to yours.

Regards,
Dalton

Hi Dalton,


Sorry for the delayed response. I am investigating this issue and will soon assist you further with my findings.
Hi Dalton,

I was able to reproduce this issue at my end using above mentioned sample code with the latest version of Aspose.Tasks for .NET 5.6.0 and have logged it in our bug tracking system under issue id: TASKS-33380. Development team will look into it and once we have any information regarding the resolution of this issue, we'll update you here via this thread.

If you have any other query/inquiry regarding Aspose.Tasks, please feel free to post to us. We'll try to assist you further as soon as possible.

The issues you have found earlier (filed as TASKS-33380) have been fixed in this update.


This message was posted using Notification2Forum from Downloads module by Aspose Notifier.
Hi Dalton,

Could you please provide us your feedback with the new version we have released? We have tested this version with a sample project having ~7K tasks and ~15K task links and the files loads in total 15 seconds as we have done a lot of refactoring to Recalculation of tasks. In case the issue still exists, we need more information about how the project data is loaded into the project from database. Your feedback will help us look into any further improvement in this regard.

The issues you have found earlier (filed as ) have been fixed in this Aspose.Words for JasperReports 18.3 update.