I'm trying to speed up my overnight extract by getting the updates on my larger tables from a journal file generated from a mimicked server. This way I can just download all the changes instead of the entire table. Getting to the journal records isn't difficult (thanks to my AS400 systems admin), and I can select all those generated on a particular day for a particular table.
The issue I'm having is that the journal record contains a field JOESD that holds the entire changed record for the associated table. This field is held as a string. I can't map this directly to a string on my SQL box as any numeric values get interpreted as control codes and cause an error in SSIS. I need to be able to map this field onto a bytestream or something similar, so I can then hopefully further process out into proper data.
I can't get the data into a bytestream, as using the advanced editor to change the datatype of the field into one causes an error.
Does anyone know how to deal with this situation?