Extract tar.gz archive into different folders (due to limitations)

Question

here is my original code:

import tarfile

file = tarzip.open(r'directory')
file.extractall(r'directory')

But I received the exception, because the target folder had limitation to 400k files.

Could you, please, advice me, how to split the extract into 6 different folders (archive has ~1.5m xml files)?

Thank you in advance!

Answer 1

You can loop over all the files in the archive using file.getmembers() or file.getnames(). Inside the loop use file.extract() to extract the file to wherever you want to.