BI Process Scheduling: How to Orchestrate and Update Running Processes

  • Albert Nogués
  • Juan Valladares
Chapter

Abstract

So far, we have built our solution, from the database until the reporting layer and the budgeting system. Maybe you have built the best dashboard ever seen with all the KPIs that your users need to analyze but your users will want fresh data periodically. This means that we must put a system in place that runs every day; or with the frequency we need; and in case of any error or issue during the load process, we get at least an alert, so whoever is in charge can review and analyze what has happened. In this chapter, we will see first, how to finish our ETL project by designing a final job that will launch the transformation, gather information, and control the flow from its execution; and take care if something goes wrong. Then, we will move on to see what mechanisms PDI has to trigger jobs and transformations, and then we will move on to see how to schedule them.

Keywords

Maintenance Task Transformation Step Staging Area Unix System Task Scheduler 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Copyright information

© Albert Nogués and Juan Valladares 2017

Authors and Affiliations

  • Albert Nogués
    • 1
  • Juan Valladares
    • 1
  1. 1.BarcelonaSpain

Personalised recommendations