Friday, July 27, 2012 8:54 PM
The way my master -child packages are set up is as follows:
1) I have a Excel CSV file which contains: Package Order, Package Name and Package Location.
2) At the start of my master package- I load the packages to execute from the excel file on a sql server table and use a ForEachLoop Container to Execute the child Packages ( I do have a Execute Package Task inside the ForEachLoop Container)
3) The set up above is in working condition.
4) I have several chilld packages whose execution should begin only after some of the packages are execute. ( the execution of packages depend on the execution of other packages) and there are also some packages which can be exectued in pararell.
1) I want to what changes do I need to make in order to implement package dependencies and parallelism in my etl ?
2) Also I want to re-design my package in such a way that it dynamically builds Master Packages containing all Child Packages ( Dynamically generate Master Package in such a way that it shows all child packages with the flow dependencies and parallel --something like dynamic package generator. In that way when I make changes to the file ( add more packages / substract packages I just have to make changes to the file ----NOT load data into the SQL SERVER table) and have a package which will generate a child packages flow execution.
Sunday, July 29, 2012 9:20 PMModerator
if you want to create your master package dynamically, you can do that with C# application to create XML. all SSIS packages are XML Based, so within the code you can create everything you want. and you can also fetch child packages, their execution order and parallelism options, and consider all of these options when you want to append an Execute Package Task inside the master package from your code.