Search This Blog

Sunday, March 25, 2012

Sort Final Result Column Setting ignored in SSIS mode

The "Sort Final Result (Column)" setting does not work when the ETL engine is set to SSIS mode.   The intent of this setting is to control the sort of the final results table.

When using the  SSIS ETL engine, the final results table (_FILT) sort is ok, however, when the data is deployed to the dimension, application or custom table, the data appears scrambled and out of order.

Example of setting:


To solve this problem, please download the following patch:
  • BPMC_ETL_Engine_v3.0.1.dtsx - Replace the current DTSX file in your environment with this package. This applies an explicit sort clause at the point when the data is move from the final results (_FILT) to the destination.
  • p_ETL_AUTOBUILD_PRE_v1.3.sql  - Execute this script in SQL Server against the BPM Connect database.   This script is specific to dimension based feeds, and applies a explicit sort to the mbrpreload_ table

See following reference to determine your current DTSX engine file:
http://bpmconnect.blogspot.com/2010/06/how-to-determine-what-version-of-etl.html

No comments:

Post a Comment