Saturday 22 June 2013

Aggregator is just like a calculator in Informatica mappings.

It helps us to do calculations like, SUM(+),MINUS(-), MAX,MIN etc.


Lets take one scenario where you need to find,MAX salary by DEPARTMENT.


DATA we have is,




How do you solve the same problem in real world?

First you will group the employees working in same department and then you can easily identify which employee is getting max salary.


In Informatica world also we follow the same procedure.










As you can observe above, we set the group by for DEPTNO and we are finding MAX_SAL in the below port.

In similar way we can use other aggregate functions as well.

You can use condisional clauses to reduce the number of rows used in the aggregation.

For example to calculate sum of salary of managers who have 5 years of experience,

SUM(SAL,experience =5)

You can also use Non-Aggregate Functions like,

IIF(MAX(SAL)>100,MAX(SAL),0))

Try using these conditions as well in the output port MAX_SAL of  mapping.


Click Here to Download Mapping.

Click Here to Download Scripts to create EMP table.


What will happen if you do not set the group by port?

Integration Service will return only last row received.

Uncheck the group by port in above mapping and try to see above behavior.

So you are done with your first Mapping on Aggregator Transformation.

So what next? Actually we can help aggregator to improve its performence.

Why we need to do so? What happens if we do not help him?

You can find that in next post.










43 comments:

  1. Informatica Data Quality Online Training
    www.21cssindia.com/courses/informatica-idq-online-training-98.html
    Online training informatica data quality, online informatica data quality training, informatica data quality online training from India , informatica data quality course ...
    Informatica ILM Training| Informatica ILM Online Training ...
    www.21cssindia.com/courses/informatica-ilm-online-training-245.html
    Informatica ILM Online Training. Click Here For Enquiry. Introduction to ILM Data Archive. Describe Informatica's approach to data archive; Introduction to the ILM ...
    informatica mdm online training| informatica mdm training ...
    www.21cssindia.com/courses/informatica-mdm-online-training-99.html
    Online training informatica mdm, online informatica mdm training, informatica mdm online training, informatica mdm training, informatica mdm enquiry, .

    ReplyDelete
    Replies
    1. Hi Pradeep,

      Hip Hip Hooray! I was always told that slightly slow in the head, a slow learner. Not anymore! It’s like you have my back. I can’t tell you how much I’ve learnt here and how easily! Thank you for blessing me with this effortlessly ingestible digestible content.
      I too did parallel upgrade from informatica 9.6.1 AIX to 10.1.0 Linux. since it is a parallel Upgrade, it doesn't affect the existing Environment.
      Yes, we have few enhancements effective from 10.X
      1. Provided GUI to know the server statistics(CPU,memory) consumed by node.
      2. Scheduler service to schedule Data quality Jobs.
      3. Resource scheduler to distribute the jobs across the nodes in the setup.
      4. Email service to send an email notification about the status of the IDQ Jobs.
      5. Sqoop connectivity to Hadoop.
      It allows you to proactively discover, profile, monitor, and cleanse your data in a consistent and reusable manner- regardless of the underlying platform and technologies.
      But great job man, do keep posted with the new updates.

      Grazie,
      Heena

      Delete
    2. Hello,


      Gasping at your brilliance! Thanks a tonne for sharing all that content. Can’t stop reading. Honestly!

      I have mapped both the sets of ports to one expression transformation. I want to apply a different logic for the string ports and a separate one on the number ports as below -

      String ports -> column_name || 'xyz'
      Number ports -> column_name + 3

      If I use %ALL%, it creates a port for all the ports i.e. I have the following ports created,

      A_COLUMN || 'xyz'
      B_COLUMN || 'xyz'
      C_COLUMN || 'xyz'-> gives error since it is a number port
      A_COLUMN + 3 -> gives error since it is a string port
      B_COLUMN + 3 -> gives error since it is a string port
      C_COLUMN + 3

      I want the below listed ports to be created in the expression transformation -

      A_COLUMN || 'xyz'
      B_COLUMN || 'xyz'
      C_COLUMN + 3

      How can this be achieved?






      By the way do you have any YouTube videos, would love to watch it. I would like to connect you on LinkedIn, great to have experts like you in my connection (In case, if you don’t have any issues).
      Please keep providing such
      valuable
      information.


      Obrigado,

      Delete
  2. Informatica Data Quality Online Training
    www.21cssindia.com/courses/informatica-idq-online-training-98.html
    Online training informatica data quality, online informatica data quality training, informatica data quality online training from India , informatica data quality course ...
    Informatica ILM Training| Informatica ILM Online Training ...
    www.21cssindia.com/courses/informatica-ilm-online-training-245.html
    Informatica ILM Online Training. Click Here For Enquiry. Introduction to ILM Data Archive. Describe Informatica's approach to data archive; Introduction to the ILM ...
    informatica mdm online training| informatica mdm training ...
    www.21cssindia.com/courses/informatica-mdm-online-training-99.html
    Online training informatica mdm, online informatica mdm training, informatica mdm online training, informatica mdm training, informatica mdm enquiry, ... Call Us +919000444287

    ReplyDelete
    Replies
    1. Hi Buddy,

      Thank you SO MUCH! I was actually holding my breath as I followed these directions. It worked beautifully!

      I don’t think there is a way to differentiate the source of updates as IDD bulk import is nothing but a group of IDD updates. Probably, you can see whether you can add a dummy field in the base object such as 'source of update' and populate it with any identifier for bulk import. You can then use this identifier in the user exit to identify the source of update.

      By the way do you have any YouTube videos, would love to watch it. I would like to connect you on LinkedIn, great to have experts like you in my connection (In case, if you don’t have any issues).
      Please keep providing such valuable information.

      Muchas Gracias,
      Sam

      Delete
  3. Thanks For Sharing.This is very useful Information.I agree with you.for more information follow the link

    http://www.tekclasses.com/informatica-online-training-best-informatica-training-in-bangalore-informatica-training/


    http://www.tekclasses.com/informatica-training-in-bangalore-informatica-training/

    ReplyDelete
    Replies
    1. Hi Pradeep,

      Great info! I recently came across your blog and have been reading along.
      I thought I would leave my first comment. I don’t know what to say except that I have

      I used Java Transformation to achieve this Informatica IDQ training USA. There is a built in function in Java Transformation called InvokeJExpression() which will take a String as Expression and a array of arguments, using which I could get dynamic arithamatic logic which changes for each row.


      Super likes !!! for this amazing post. I thinks everyone should bookmark this.

      Thanks and Regards,
      Kevin

      Delete
  4. Thanks For Sharing.This is very useful Information.I agree with you.follow the deatails
    http://www.tekclasses.com/informatica-online-training-best-informatica-training-in-bangalore-informatica-training/


    http://www.tekclasses.com/informatica-training-in-bangalore-informatica-training/

    ReplyDelete

  5. The information which you have provided is very good. It is very useful who is looking for Informatica Online Training.

    http://www.tekclasses.com/informatica-online-training-best-informatica-training-in-bangalore-informatica-training/


    http://www.tekclasses.com/informatica-training-in-bangalore-informatica-training/

    ReplyDelete
  6. Thanks for Sharing Usefull information

    http://www.tekclasses.com/informatica-online-training-best-informatica-training-in-bangalore-informatica-training/


    http://www.tekclasses.com/informatica-training-in-bangalore-informatica-training/

    ReplyDelete
  7. hi you have gathered a valuable information on Informatica...., I am looking for content like this and i am much impressed with the information and nice course content, thanks a lot for the Information regarding Informatica
    http://www.tekclasses.com/informatica-online-training-best-informatica-training-in-bangalore-informatica-training/


    http://www.tekclasses.com/informatica-training-in-bangalore-informatica-training/

    ReplyDelete
  8. Pretty great post. I just stumbled upon your blog and wished
    Thanks for some other magnificent post.for more details

    http://www.tekclasses.com/

    ReplyDelete
  9. Plenty of new stuff proper here!visit the below link

    http://www.tekclasses.com/

    ReplyDelete
  10. Brillant piece of information,if u r interested follow below link
    http://www.tekclasses.com/

    ReplyDelete
  11. As we heared more and more tips which enable us for writing for the content. But with this especially how the authoritative really nice. I agree with your 3 point include with more images and videos. It will enable the readers without any confused or any other thing and finally cleared with what we are going to tell.


    Back to Original Services Private Limited

    ReplyDelete
  12. Thanks for this great information...I like this blog and it's very informative.
    Informatica online training

    ReplyDelete
  13. Thank you for this great article which conveyed a good information.keep more updates.
    SEO Services in India

    ReplyDelete
  14. Servicenow Online Training in Hyderabad by SV Soft Solutions
    Schedule and attend free demo here!
    http://www.svsoftsolutions.com/courses_servicenow.aspx
    USA: : +1-845-915-8712
    India: +91-9642373173
    Mail: info@svsoftsolutions.com
    Website: http://www.svsoftsolutions.com

    ReplyDelete
  15. This comment has been removed by the author.

    ReplyDelete
  16. Hello Mate,


    Thanks a trillion mate!

    It works like charm, saved a lot of energy & time.

    There are two sessions, A and B. B needs to run on saturday once and A needs to run every 5 minutes once B completes on Saturday. Please help me as how can i Schedule these sessions. I am ready to change it to 2 workflows, but how can i make, one workflow dependent on other?


    Excellent tutorials - very easy to understand with all the details. I hope you will continue to provide more such tutorials.
    Thank you,
    Krishna Kumar

    ReplyDelete
  17. Hola peeps,


    Allow me to show my gratitude bloggers. You guys are like unicorns. Never seen but always spreading magic. Your content is yummy. So satisfied.

    The repository is configured on Oracle database, Oracle Linux client is installed, sqlplus from informatica linux instance working to this oracle database,

    NLS_LANG,
    ORACLE_HOME,INFA_JDK_HOME,INFA_CODEPAGENAME,ORACLE_SID,ORACLE_UNQNAME and PATH variables are set on this informatica linux instance.





    I am so grateful for your blog. Really looking forward to read more.


    Obrigado,
    Morgan

    ReplyDelete
  18. Hi There,


    Gratitude for putting up this prolific article! You truly make everything a cake walk. Genuinely good stuff, saving time and energy.

    I am newbie to Informatica, we have a requirement to Integrate to SFDC to SQL server using PowerCenter, for this I downloaded PowerCenter express Developer edition but couldn't see any provision for Salesforce say any connectors or Adaptors.
    I read Powerexchange is used to connect to SFDC and register as Salesforce objects and then plug-in needs to be installed in PCExpress then integration could happen.
    If anyone could provide the document or steps for this that would be really helpful.
    By the way do you have any YouTube videos, would love to watch it. I would like to connect you on LinkedIn, great to have experts like you in my connection (In case, if you don’t have any issues).
    Please keep providing such valuable information.


    Merci Beaucoup,
    Edison

    ReplyDelete
  19. Hi Pradeep,

    Smokin hot stuff! You’ve trimmed my dim. I feel as bright and fresh as your prolific website and blogs!

    Oracle’s cloud infrastructure enables existing on premise applications and databases to be easily moved to the cloud while preserving ownership of administration, customization, and security. You’ll hear how customers can move Oracle and other applications to OAF Training Cloud, automate workload migrations to the cloud, and migrate from a traditional data center to an open cloud infrastructure. Attendees will also hear about strategy and thought processes customers have faced when considering private or public cloud, along with implementation strategies, lessons learned, and integration setup.







    Follow my new blog if you interested in just tag along me in any social media platforms!





    Kind Regards,
    Irene Hynes

    ReplyDelete
  20. Salama Aleikum,


    Amaze! I have been looking bing for hours because of this and i also in the end think it is in this article! Maybe I recommend you something helps me all the time?

    Looking for a template (Excel is best) to document all the IDQ rules. The intention is that this template Informatica IDQ training USA will be passed to the data owners to share the rules with development team in a detailed way. Look for what all attributes are must to gather.
    Awesome! Thanks for putting this all in one place. Very useful!

    Kind Regards,

    ReplyDelete
  21. Hello Mate,


    Muchas Gracias Mi Amigo! You make learning so effortless. Anyone can follow you and I would not mind following you to the moon coz I know you are like my north star.
    I started using Informatica IDQ training USAblog for my training practice.
    How do you install a version 10.1.1 and import projects of previous versions ? When I tried (as a workaround) to import a full repository of a previous version in the new version, I have got an error saying that I cannot do this. (I tried through the Admin console)

    I read multiple articles and watched many videos about how to use this tool - and was still confused! Your instructions were easy to understand and made the process simple.


    Thanks,
    Morgan

    ReplyDelete
  22. Hi,

    Thanks for the post, it’s a great piece of article. Really saved my day.

    Is it advisable to update a field directly into hub tables. For instance if a Name is being converted from UpperCase to TitleCase instead of processing all the updates through hub jobs, Informatica MDM Training USA can we directly update the stage/ BO tables.

    If so, can you please share the list of tables that need to be updated.


    But nice Article Mate! Great Information! Keep up the good work!
    Obrigado,
    Irene Hynes

    ReplyDelete
  23. Hi There,

    You make learning and reading addictive. All eyes fixed on you. Thank you being such a good and trust worthy guideInformatica Data quality training.

    We are working on integration of SFDC (SalesForce CRM) with Exact Target(ET) (SalesForce Marketing Clound) through Informatica PowerCenter 9.5.1.
    But facing below issues:
    1) While importing SalesForce object into PowerCenter : Getting an error "timed out".
    2) How to connect to Exact target from power Center using API (we tested this from Java by passing proxy to webservie but not sure how to pass proxy to webservice in power Center).

    Awesome! Thanks for putting this all in one place. Very useful!

    Many Thanks,
    Preethi.

    ReplyDelete
  24. Hello Mate,


    Nice to be visiting your blog again, it has been months for me. Well this article that i’ve been waited for so long.
    I started using Informatica IDQ training USA blog for my training practice.
    Is there any other study content beyond the information provided by the courses?
    I""m about to schedule my exam (section 4 in the CDI certification), but wanted to ensure (or find out) if the exam will cover more then what is in the course content.

    But nice Article Mate! Great Information! Keep up the good work!


    Many Thanks,
    Nitesh

    ReplyDelete
  25. Hi Mate,


    Smokin hot stuff! You’ve trimmed my dim. I feel as bright and fresh as your prolific website and blogs!

    I hope there are not detailed navigation questions such as I have experienced on other Informatica tests, because who memorizes each menu path dill-down to get to some detailed setting. We have moved past the old days of having to Informatica IDQ training USA remember long DOS string commands. That's why we have a menu navigation system today.






    THANK YOU!! This saved my butt today, I’m immensely grateful.


    Thank you,

    ReplyDelete
  26. Thanks for providing your information, keep update and share with more information regarding Informatica get touch with Informatica Online Training Bangalore

    ReplyDelete
  27. Thank you so much for providing and finding out how necessary and useful Informatica and its components are.All this in a way turn out useful and applicable as well.

    Informatica Read Rest API

    ReplyDelete