Wednesday 30 July 2014

Avoid Sort Transformation in SSIS




           If we use Sort transformation for large data sets, performance issues will come. So we need to avoid sort transformation.

Example:
  • Edit the source (excel or OLEDB source) and change the “Data access mode:” to “SQL Command”.

  • Writ the select statement for source table with order by (on required fields).



  • Click “OK”.
  • Right click on the source and select “Show Advanced Editor” option.

  • “Advanced Editor for OLEDB Source” window will open. Click on “Input and Output Properties” option.

  • In the “Inputs and Outputs:” section, select the “OLEDB Source Output”.

  • Right side of the window “Common Properties” will enable.

  • Set “IsSorted” property as true.

  • In “Inputs and outputs:” section expand the “OLEDB Source Output” list.

  • Expand the “Output Columns” list. And select ID column because we need to sort the source data based on ID column.

  • ID column “common Properties” list set the “SortKeyPosition” as “1”.

  •  If you want to add one more column in sorted list. Select required column and set the "SortKeyPosition" value "2".
  • Click “OK” button to complete the sorting.
  • One sorted data set is ready.
  •  Same way we can prepare remaining required sorted data sets, without using sort transformation.