I built a pipeline which reads from confluent kafka it processes the records and then use side outputs to split them into rejected and approved pcollections, th
I need to get the data from data lake to dataverse database using dataflow.
I'm using StreamSets and will soon need to load data from fixed length file and packed decimal (cobol comp-3) to insert into Postgres to regular number numeric(
I'm new to Azure Synapse and currently have the following problem: I get a json that looks like the following: { "2022-02-01":[ { "shiftId": , "
we have a long running pipeline and we would like to add the timestamp to the filenames as close to the pipeline ends' time as possible. The solution we have co
I'm having a problem with my dynamic table name in ADO.NET Destination. The control flow is: SQL Query that bring me all the tables I need from an OLE DB connec
I'm trying read a file from a directory that contains square brackets in the path using a mapping dataflow in Azure Synapse, like this: /path/to/[a].[b]/some/fi
I have an Apache Beam streaming project that calculates data and writes it to the database, what is the best way to reprocess all historical records after a bug
I am trying to create a pipeline which is reading some data from Pubsub and writing to into a postgres database. pipeline_options = PipelineOptions(pipeline_arg
I use the plugin total.js flow. I would like to know if there is a function like FLOW.Reload() to dynamically reload the components?
I'd like to get flow like this one on the picture. Is there any way to intercept all HTTP request within a docker container, modify their headers and then send
I'm putting my application on an IIS HTTP server, but I get an error: WebSocket connection to 'wss://xxxx.xxxx.xx:xxxxx/?designer=1&token=&baa=' f
I would like to get parameter on my flow, for example, http://localhost:8000/?param1=12. If i want to recup param1 in my application, how and where can i do it
How to use dynamic url for http-request in total.js flow. I am able to get params from route component but how to pass this to http-request url ?
I am trying to create a dataflow template using the below mvn command And i have a json config file in the bucket where i need to read different config file for
I have a problem in SSIS, with a simple data flow task between a sql SELECT and a CSV destination. I don't retrieve trailing spaces in string columns of the des