'cdap - cloudfusion - parse csv and apply schema

I am trying to create a pipeline which performs following task.

  1. read and parse the csv file
  2. apply schema on top of that
  3. records which are mapping schema is written to a valid bigquery table
  4. records which doesn't match schema (i.e. if column expect int but in file it's string) it goes to reject bucket.

I have write following pipeline. However, the problem is, I don't see any records going to either rejected or bigquery.

if schema is not matching, shouldn't it go to reject?

enter image description here

google-cloud-data-fusioncdap


Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source

Related Questions