F5 Debug…

Building & Debugging the Technology!!!

Archive for April, 2011

SQL Server Integration Services (SSIS) – Part 59 – Data Viewers (Column Chart) in SSIS

Posted by Karthikeyan Anbarasan on April 29, 2011

This is part 59 of the series of article on SSIS

Introduction:

In this article we are going to see on how to use the Data viewers (Column Chart) in SSIS packaging. Data viewers are used as one of the debugging option for the developers to check the data between the processes of a packaging. Data viewers are good at places where we have a minimum data to analyze and then executing the package at the development stage to see the changed took place in the prior task and proceed to the next task. Let’s jump start to see this sample on how to set the properties of the control.

You can look into my series of article on SSIS at the url - http://f5debug.net/all-articles/

Steps:

Follow steps 1 to 3 on my first article to open the BIDS project and select the right project to work on integration services project. Once the project is created, we will see on how to use the data viewers to see the data flow. Now once the project is opened drag and drop a source and a destination task along with a dataflow to do some manipulation as shown below

Now we will do a small task on copying the data from the source table to a destination file using the OLEDB source and FlatFile destination as shown above.

Now let’s configure both the tasks to make a flow as shown below

Source Configuration:

Destination Configuration:

Now your screen looks like below after the configuration is completed

Now when we execute the package it will do the execution but we are not sure at what point what happens. So in order to see the transformation between the source and the destination we can use a data viewer browser.

Data viewer provides different options to view the data, the types are: Grid, Histogram, Scatter Plot, and Chart Format.  In this sample we will see on how to use the Column Chart option to view. To start the data viewer Right click on the green arrow which connects the source and destination and select the data viewer. It will open the window as shown below

Now click on Add button to do the configuration of our required data viewer. It will open the window as shown below

Now we will select the Column Chart since we are going to see on how to use the Column Chart. We have a tab Column Chart just navigate to that tab and select the column as shown below

Now we are done with the configuration and ready to execute the package. We can see a viewer icon next to the arrow as shown below which indicates that the viewer is active to view.

Now we will execute the package and see the data viewer browser. Press F5 to execute the package and we can see the data viewer browser as shown in the below screen

We have an arrow button in the browser, once we are done with our analysis we can click on the button to proceed. Once we click that button the execution start and proceed further and the final screen will appear as below

Conclusion:

So in this article we have seen on how to use the data viewer (Column Chart) to analyze the data and to proceed further which acts like a debugging portion for SSIS packaging

Posted in SSIS | Tagged: , , , , , , , , , , , , , , , , , , , , , , | Leave a Comment »

SQL Server Integration Services (SSIS) – Part 58 – Data Viewers (Scatter Plot) in SSIS

Posted by Karthikeyan Anbarasan on April 29, 2011

This is part 58 of the series of article on SSIS

Introduction:

In this article we are going to see on how to use the Data viewers (Scatter Plot) in SSIS packaging. Data viewers are used as one of the debugging option for the developers to check the data between the processes of a packaging. Data viewers are good at places where we have a minimum data to analyze and then executing the package at the development stage to see the changed took place in the prior task and proceed to the next task. Let’s jump start to see this sample on how to set the properties of the control.

You can look into my series of article on SSIS at the url - http://f5debug.net/all-articles/

Steps:

Follow steps 1 to 3 on my first article to open the BIDS project and select the right project to work on integration services project. Once the project is created, we will see on how to use the data viewers to see the data flow. Now once the project is opened drag and drop a source and a destination task along with a dataflow to do some manipulation as shown below

Now we will do a small task on copying the data from the source table to a destination file using the OLEDB source and FlatFile destination as shown above.

Now let’s configure both the tasks to make a flow as shown below

Source Configuration:

Destination Configuration:

Now your screen looks like below after the configuration is completed

Now when we execute the package it will do the execution but we are not sure at what point what happens. So in order to see the transformation between the source and the destination we can use a data viewer browser.

Data viewer provides different options to view the data, the types are: Grid, Histogram, Scatter Plot, and Chart Format.  In this sample we will see on how to use the Scatter Plot option to view. To start the data viewer Right click on the green arrow which connects the source and destination and select the data viewer. It will open the window as shown below

Now click on Add button to do the configuration of our required data viewer. It will open the window as shown below

Now we will select the Scatter plot(x,y) since we are going to see on how to use the Scatter plot. We have a tab Scatter Plot just navigate to that tab and select the column as shown below

Now we are done with the configuration and ready to execute the package. We can see a viewer icon next to the arrow as shown below which indicates that the viewer is active to view.

Now we will execute the package and see the data viewer browser. Press F5 to execute the package and we can see the data viewer browser as shown in the below screen

We have an arrow button in the browser, once we are done with our analysis we can click on the button to proceed. Once we click that button the execution start and proceed further and the final screen will appear as below

Conclusion:

So in this article we have seen on how to use the data viewer (Scatter Plot) to analyze the data and to proceed further which acts like a debugging portion for SSIS packaging

Posted in SSIS | Tagged: , , , , , , , , , , , , , , , , , , , , , , | Leave a Comment »

SQL Server Integration Services (SSIS) – Part 54 – Transformation Categorized in SSIS

Posted by Karthikeyan Anbarasan on April 28, 2011

This is part 54 of the series of article on SSIS

Introduction:

In this article we are going to see on the different transformation on how they are categorized to use it across the package. This categorization is based on the usage of the transformation and the process on how it can be used across. The brief description of each of the transformations are available in my previous articles.

You can look into my series of article on SSIS at the url - http://f5debug.net/all-articles/

We can partition the transformation into 7 types as shown below

  1. Row Transformations
  2. Rowset Transformations
  3. Split and Join Transformations
  4. Quality Transformations
  5. Mining Transformations
  6. Synchronous and Asynchronous Transformations
  7. Other Transformations

Now these transformations are further sub categorized as below

Row Transformations – Used to update column values and is applied to each row in the input dataset.

  • Character Map
  • Copy Column
  • Data Conversion
  • Derived Column
  • Script Component
  • OLE DB Command

Rowset Transformations – Used to create a new Rowset

  • Aggregate
  • Sort
  • Percentage Sampling
  • Row Sampling
  • Pivot
  • Unpivot

Split and Join Transformations – Used to distribute rows to different outputs, create copies of the transformation inputs

  • Conditional Split
  • Multicast
  • Merge
  • Merge Join
  • Union All
  • Lookup

Data Quality Transformations – Used to perform data quality operations

  • Fuzzy Lookup
  • Fuzzy Grouping

Data-Mining Transformations – Used to perform data-mining operations

  • Data-Mining Query
  • Term Extraction
  • Term Lookup

Synchronous and Asynchronous Transformations – Used to determine how rows are processed.

  • Synchronous transformations
  • Asynchronous transformations
  • Partially blocking transformations
  • Blocking transformations

Other Transformations – Some extra transformations

  • Export Column
  • Import Column
  • Audit
  • Row Count
  • Slowly Changing Dimension

Conclusion:

So in this article we have seen on the different transformation and the subcategories of each section

Posted in SSIS | Tagged: , , , , , , , , , , , , , , , | Leave a Comment »

SQL Server Integration Services (SSIS) – Part 55 – Connection Managers in SSIS

Posted by Karthikeyan Anbarasan on April 28, 2011

This is part 55 of the series of article on SSIS

Introduction:

In this article we are going to see on the different connection managers available in SSIS packaging and the purpose of each transformation. We have 17 different connection managers across the SSIS packaging in order to use it for different purposes.

You can look into my series of article on SSIS at the url - http://f5debug.net/all-articles/

List of Connection Managers:

S No

Name

Short Description

1

ADO Used to connect to ActiveX Data Objects (ADO) objects, like a recordset.

2

ADO.NET Used to access data sources by using a .NET provider and Microsoft SQL Server and XML

3

Cache Used to read data from the cached server or from a cache file(.caw) so that the data is stored in the memory.

4

Excel Used to connect to an existing Microsoft Excel workbook file for both Source and Destination processing of package

5

File Used to connect to an existing file or to create a new file and use as a source or a destination.

6

FlatFile Used to connect to a Flat file which acts like a source or a destination for the package to access and process the data across the platform.

7

FTP Used to connect to a File Transfer Protocol Server to fetch the data or to update the data to the server.

8

HTTP Used to access the webserver using the Hyper text transfer protocol to send and receive files across the servers

9

MSMQ Used to connect to the Microsoft Message queuing server to access the messages as a source or to update the message as a destination

10

MultiFile Used to reference to the existing file or folders or to create a new file and use it as a reference at runtime.

11

MultiFlatFile Used to access the file using the flat file as multiple data source like using inside a loop container to loop through the file and access the data

12

OLEDB Used to connect to the different data source using the OLEDB provider specifically used to connect to Microsoft SQL Server.

13

ODBC Used to connect to different relational database system using the open connectivity provider

14

SMOServer Used to connect to a SQL Management server objects to access for as a source or to update as a destination

15

SMTP Used to connect to a Simple Mail transfer Protocol server to access and send mail or to receive mails

16

SQL Compact Used to connect to SQL Server Compact database for light weight accessing of the server.

17

WMI Used to connect to the Windows Management Instrumentation (WMI) in order to connect to the enterprise server for management.

Conclusion:

So in this article we have seen on the different connection managers used in the SSIS Packaging.

Posted in SSIS | Tagged: , , , , , , , , , , , , , , , , | Leave a Comment »