150GB mbox failing at 37K documents

Hi

It is difficult for me to give you a 150GB file to test, but wanted to check if there are any limits to parsing mbox files? this mbox has about 230K messages, but it fails at about 37K consistently. I broke up the mbox files, and it seemed to no have an issue. But you can understand the pain in opening and parsing a 150GB file maually.

Can you point me to the best way to process and extract individual messages for large mbox files?

Thanks

Rakesh

these are archives out of gmail takeout. seems to be having issues.

@rakesh_bhatt,

There isn’t any such limitation known to us for large size MBox files. The issue may arise due to some specific messages may be for which we’ll be in need of sample data to test this at our end. The standard way of extracting messages from MBox files is the same as mentioned in our documentation article and there is no other method to access messages.