'SSIS Package Export on-premise SharePoint List to SQL Server

I have created an SSIS package on my local development machine that is running VS2019 Prof and SQL Server 2019.

Every thing is working as expected, but I have one SharePoint List with 10,000 items which keeps failing with the message:

Error: 0xC02090F5 at Load Data From SharePoint Absence List, Absence [2]: The Absence was unable to process the data. An error occured when reading the OData feed.
Error: 0xC0047038 at Load Data From SharePoint Absence List, 
    SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on Absence returned error code 0xC02090F5.  
                                                            The component returned a failure code when the pipeline engine called PrimeOutput(). 
                                                            The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  
                                                            There may be error messages posted before this with more information about the failure.

It always fails at the same record with is just under 4,000 transferred. This is the only error that I have found.

I have exported the data from SharePoint into Excel, which returns the full dataset and cannot see any issues with the data.

The SSIS package is using an OLE Db connection to access the data, other SharePoint lists are read and completed by the same SSIS package using the same connection.

My thoughts:

  • Is this an OLE Db issue?
  • Do I need to set some parameter to the OLE Db connection?
  • Does this need to be sperated into it's own SSIS package?
  • Can I find out more information about the specific error?

Does anyone have any helpful advice on how to proceed?

I have tried:

  • Adding SharePoint Libraries
  • Started looking at Power Automate, learning curve
  • Power BI, but again a learning curve, so far I have created a data query which can see all of the items in the list, great, but I have no idea on how to push the dataset into SQL Server. I've created a transformation and tried Python, but that does not work.

UPDATE

I have checked the data in the record and everthing is OK. No hidden formating or odd charactors, date all in UTC format, etc...



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source