'Big file upload strategy in node js and aws s3

I am working in application where react js application uploading files to backend ( node js, Loopback 4 based ) and backend then send those files AWS S3 Bucket. Also upload is multiple files based so can lead up any number of files within groups something like below

POST Request

Group 1
   Group Type: Text
   File 1    
   File 2    
   File 3    
Group 2
   Group Type: Text
   File 4    
   File 5    
   File 6    
Group 3
   Group Type: Text
   File 7    
   File 8    
   File 9

One single Form Data request sending all these details to backend server. For now every this is working file for files.

Now as per production requirements, These files can be very big, like some of files above than 100MB but less than 500MB. I am thinking, on average it is possible to upload GBs of file upload in single POST Request.

This make me to rethink whole solution is feasible or not and if failure chances will increase in production with each such request. While Node Js/Multer application itself do not have limits ( and I can update those limits if required ).

Their is one idea to make whole upload process interactive by showing upload progress, also add some solution where user can work to other pages while files is still uploading ( As these are react SPA pages may be redux can handle this or not) something like AWS create services.

Lastly I am thinking if instead of upload by frontend, some FTP server setup and schedule sync files to S3 by backend scripts is better and safe idea. Later by web sockets we can inform user to sync completion.

If their is some industry standard approach to make such solution.



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source