'Oracle Apex parsing a huge file

I have a technical question, what would be the best way to parse a huge file in (or outside) Apex? I would like to use the data coming from an Apex collection (e.g. a list of IDs) to extract data (genomic data, vcf format) from a large file (1.000.000 x 10.000 lines) and to provide the parsed data as download. Is this possible with Apex? Currently I think a Rest Api would work (e.g. with Python) but in case if there is a simpler way, I would appreciate it. Another possibility would be to store the large datasets in a database but oracle DB has limitations of the rows and columns size, so I think this is not an option (please correct me,if I am wrong)



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source