Skip to main content

Separating duplicate and non-duplicate rows to separate tables



                                                                                                                                                                      
Scenario:

Separating duplicate and non-duplicate rows to separate tables

Solution:

Please follow the below steps
  1. After source qualifier, send data to aggregator transformation and use count agg function
  2. after aggregator transformation, pass data to the Router in which create two route as duplicate where count>1 and non-duplicate where count=1
  3. Then send data to the respective target tables


                                                                                                                                                                      

Comments

  1. Hi,

    After the Aggregation you will lose all of the original rows. So this Solution might not work as expected.

    Thanks,
    Acharya

    ReplyDelete

Post a Comment

Popular posts from this blog

SQL Transformation with examples

============================================================================================= SQL Transformation with examples   Use : SQL Transformation is a connected transformation used to process SQL queries in the midstream of a pipeline . We can insert, update, delete and retrieve rows from the database at run time using the SQL transformation. Use SQL transformation in script mode to run DDL (data definition language) statements like creating or dropping the tables. The following SQL statements can be used in the SQL transformation. Data Definition Statements (CREATE, ALTER, DROP, TRUNCATE, RENAME) DATA MANIPULATION statements (INSERT, UPDATE, DELETE, MERGE) DATA Retrieval Statement (SELECT) DATA Control Language Statements (GRANT, REVOKE) Transaction Control Statements (COMMIT, ROLLBACK) Scenario: Let’s say we want to create a temporary table in mapping while workflow is running for some intermediate calculation. We can use SQL transformat...

Informatica Quiz: Set 1

                                                                                                                                                                    ...

Convert Numeric Value to Date Format

                                                                                                                                                                     ...