SSIS Data Flow Error Handling With Description and Column Name

Finding an error description is a simple task involving one line of code — but finding the error column name is not so simple. Microsoft made it easy with SQL 2016's modified API. But with prior versions, it's a really difficult job to find the error column name using just a script task and script component.

This article provides a simple step-by-step solution to find the error description and error column name.

Scenario

We are trying to insert records from a flat file to our SQL table. The flat file has two columns: roll and name. Sometimes, the name column contains huge text and isn't supported by our table object (the size of the name column the in table object is Varchar(50)). This generates an error. We are trying to display the error description and the column name that generated the error.

Control/Data Flow Details

Control Flow: Get Lineage ID Task

This script task is used to grade the lineage ID at runtime and save it as a text file.

1. Create a text file: C:\temp\write.txt.

2. Create two package-level variables named User::execsObj and User::lineageIds as the object types. Pass them as the Read-Write variables of the script task.

3. In the script task, add an assembly named Microsoft.SqlServer.DTSPipelineWrap: 

   7

   1

   using System;

   2

   using System.Data;

   3

   using Microsoft.SqlServer.Dts.Runtime;

   4

   using Microsoft.SqlServer.Dts.Pipeline.Wrapper;

   5

   using System.Windows.Forms;

   6

   using System.Collections.Generic;

   7

   using System.IO;

   Script task code in C#:

   65

   1

   {

   2

    // Grab the executables so we have to something to iterate over, and initialize our lineageIDs list

   3

   // Why the executables?  Well, SSIS won't let us store a reference to the Package itself...

   4

   Dts.Variables["User::execsObj"].Value =(Package)Dts.Variables["User::execsObj"].Parent).Executables;

   5

   ​

   6

   Dts.Variables["User::lineageIds"].Value = new Dictionary<int, string>();

   7

   lineageIds = (Dictionary<int, string>)Dts.Variables["User::lineageIds"].Value;

   8

   Executables execs = (Executables)Dts.Variables["User::execsObj"].Value;

   9

   ​

   10

   ReadExecutables(execs);

   11

   ​

   12

   // Just proof of concept to see the results before you dedicate your time to the solution

   13

   // Delete this code in your actual implementation

   14

   using (StreamWriter writetext = new StreamWriter(@"C:\temp\write.txt", true))

   15

           {

   16

                   foreach (var kvp in lineageIds)

   17

                   writetext.WriteLine(kvp.Key + " : " + kvp.Value);

   18

           }

   19

               Dts.TaskResult = (int)ScriptResults.Success;

   20

   }

   21

   ​

   22

   23

   ​

   24

   private void ReadExecutables(Executables executables)

   25

   {

   26

     foreach (Executable pkgExecutable in executables)

   27

       {

   28

        if (object.ReferenceEquals(pkgExecutable.GetType(),            

   29

                    typeof(Microsoft.SqlServer.Dts.Runtime.TaskHost)))

   30

                   {

   31

                       TaskHost pkgExecTaskHost = (TaskHost)pkgExecutable;

   32

                       if (pkgExecTaskHost.CreationName.StartsWith("SSIS.Pipeline"))

   33

                       {

   34

                           ProcessDataFlowTask(pkgExecTaskHost);

   35

                       }

   36

                   }

   37

        else if (object.ReferenceEquals(pkgExecutable.GetType(), 

   38

                    typeof(Microsoft.SqlServer.Dts.Runtime.ForEachLoop)))

   39

                   {

   40

                       // Recurse into FELCs

   41

                       ReadExecutables(((ForEachLoop)pkgExecutable).Executables);

   42

                   }

   43

         }

   44

    }

   45

   ​

   46

   private void ProcessDataFlowTask(TaskHost currentDataFlowTask)

   47

   {

   48

      MainPipe currentDataFlow = (MainPipe)currentDataFlowTask.InnerObject;

   49

   ​

   50

      foreach (IDTSComponentMetaData100 currentComponent in 

   51

                     currentDataFlow.ComponentMetaDataCollection)

   52

               {

   53

                 // Get the inputs in the component.

   54

                 foreach (IDTSInput100 currentInput in currentComponent.InputCollection)

   55

                     foreach (IDTSInputColumn100 currentInputColumn in 

   56

                             currentInput.InputColumnCollection)

   57

                           lineageIds.Add(currentInputColumn.ID, currentInputColumn.Name);

   58

   ​

   59

                  // Get the outputs in the component.

   60

                  foreach (IDTSOutput100 currentOutput in currentComponent.OutputCollection)

   61

                       foreach (IDTSOutputColumn100 currentoutputColumn in 

   62

                                   currentOutput.OutputColumnCollection)

   63

                           lineageIds.Add(currentoutputColumn.ID, currentoutputColumn.Name);

   64

               }

   65

   }

Adding a Script Component to the Data Flow Task

Now, add a script component to the data flow task.

1. Pass the variable named User::lineageIds as the Read variable.

2. Script the component input columns as ErrorCode and ErrorColumn.

3. Script the component output column as ErrorDescription and ErrorColumnDescription with a DT_STR data type.

   5

   1

   using System;

   2

   using System.Data;

   3

   using Microsoft.SqlServer.Dts.Pipeline.Wrapper;

   4

   using Microsoft.SqlServer.Dts.Runtime.Wrapper;

   5

   using System.Collections.Generic;
   Script task code in C#:
   ​x

   1

   public override void Input0_ProcessInputRow(Input0Buffer Row)

   2

       {

   3

           Dictionary<int, string> lineageIds = (Dictionary<int, string>)Variables.lineageIds;

   4

   ​

   5

           int? colNum = Row.ErrorColumn;

   6

           if (colNum.HasValue && (lineageIds != null))

   7

           {

   8

               if (lineageIds.ContainsKey(colNum.Value))

   9

                   Row.ErrorColumnDescription = lineageIds[colNum.Value];

   10

   ​

   11

               else

   12

                   Row.ErrorColumnDescription = "Row error";

   13

           }

   14

           Row.ErrorDescription = this.ComponentMetaData.GetErrorDescription(Row.ErrorCode);

   15

        }

I hope you found this article informative!