|
Browse by Tags
All Tags » Patterns
- Design
- ETL Instrumentation
- series
- SSIS
-
Introduction This post is part of a series of posts on ETL Instrumentation. In Part 1 we built a database to hold collected SSIS run time metrics and an SSIS package to deomnstrate how and why we would load metrics into the database. In Part 2 we will expand on our database and the SSIS package to annotate version metadata, manage error ...
Posted to Applied Business Intelligence (Weblog) by andy on November 10, 2007
-
Introduction One of the things I appreciate about SSIS is the script elements. There is a lot of functionality built into the engine out of the box but I like the idea of having a Script Task on the Control Flow and a Script Component on the Data Flow just in case. Last month I used a Script Task to build a more flexible FTP ...
Posted to Applied Business Intelligence (Weblog) by andy on October 14, 2007
-
Introduction SSIS is a fantastic ETL engine. When I build and ETL solution in SSIS, I like to collect runtime metrics. Why? I use the data initially to determine a baseline for performance and to determine, in some cases, if I'm loading within a defined window. I refer to this process of collecting ...
Posted to Applied Business Intelligence (Weblog) by andy on July 15, 2007
-
Introduction Loading data from a data source to SQL Server is a common task. It's used in Data Warehousing, but increasingly data is being staged in SQL Server for non-Business-Intelligence purposes. Maintaining data integrity is key when loading data into any database. A common way of accomplishing this is to ...
Posted to Applied Business Intelligence (Weblog) by andy on May 21, 2007
-
I was working on error handling with SSIS recently and came up with what I believe is a snappy way to address it. The solution presented below is partial. For one, I would encourage you to use a database table to house errors; for another, I would encourage you to store lots more data than merely the ErrorDescription field. Error logging is ...
Posted to Applied Business Intelligence (Weblog) by andy on April 8, 2007
-
SSIS Design Pattern - EncryptSensitiveWithPassword Deploying SQL Server Integration Services packages is one of the steeper paths on the slopes of the SSIS learning curve. Like almost everything else in life, it makes perfect sense once you understand it. But it is completely and utterly different from anything I've ever worked with before. ...
Posted to Applied Business Intelligence (Weblog) by andy on April 3, 2007
-
Introduction I sometimes miss the ActiveX task in DTS. It was cool because ''if you could see it, you could change it.'' I used the ActiveX Task to generate dynamic SQL. When To Use Dynamic SQL In SSIS There are lots of uses for dynamic SQL in SSIS. If you find yourself using the same SQL statements over and over again with minor ...
Posted to Applied Business Intelligence (Weblog) by andy on April 2, 2007
-
I had this idea earlier to create a series of posts under the heading ''SSIS Cookbook.'' I've reconsidered the naming of the series - not the content. I'm going to call it SSIS Patterns. It will include common tasks I've run into with SSIS - and maybe a preview of upcoming technology. :{> Andy
Posted to Applied Business Intelligence (Weblog) by andy on February 4, 2007
-
I've read several MSDN SSIS Forum posts recently on the topic on configuration and deployment management. I get these questions in most of my SSIS classes as well. One suggestion I've been investigating is using the DontSaveSensitive ProtectionLevel property and passing the connection string or password at execution time. I'm a test-it-and-see ...
Posted to Applied Business Intelligence (Weblog) by andy on January 17, 2007
|
|
|