Overflow the disk I/O buffer

Mon, 09 Jul 2007 19:21:09 Z

Hello,

I am getting "overflow the disk I/O buffer" in my SSIS, and what's weird is that when I construct the same SSIS in a new package, it works perfectly. I almost want to believe that it could be a bug. Some days when I import the files, it works fine, but some days it errors out with this error on the last column. Is there some setting with CR/LF or LF that I have to pay attention to avoid this type of random error?

Thanks for your help!

-Lawrence

Overflow the disk I/O buffer

Mon, 09 Jul 2007 19:24:43 Z

Can you please provide the exact error message and any other error messages around it?

Thanks,
Phil

Overflow the disk I/O buffer

Fri, 13 Jul 2007 18:07:00 Z

[Flat File Source [439]] Error: The column data for column "Avg Position" overflowed the disk I/O buffer.

[Flat File Source [439]] Error: An error occurred while skipping data rows.

[DTS.Pipeline] Error: The PrimeOutput method on component "Flat File Source" (439) returned error code 0xC0202091. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.

[DTS.Pipeline] Error: Thread "SourceThread0" has exited with error code 0xC0047038.

[DTS.Pipeline] Error: Thread "WorkThread0" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.

[DTS.Pipeline] Error: Thread "WorkThread0" has exited with error code 0xC0047039.

Overflow the disk I/O buffer

Fri, 13 Jul 2007 18:32:44 Z

What is the data type for the column, "Avg Position" and how many bytes is each row in the file?

Overflow the disk I/O buffer

Mon, 30 Jul 2007 13:43:44 Z

Has there been a resolution to this? I have a similar problem occurring.

Overflow the disk I/O buffer

Mon, 30 Jul 2007 13:55:02 Z

Joshua Kasper wrote:

Has there been a resolution to this? I have a similar problem occurring.

No, because SQLChamp needs to respond to my last questions.

Overflow the disk I/O buffer

Mon, 30 Jul 2007 18:11:33 Z

Column in database is float.

Bytes from the text file range from 1 to 35.6

-Lawrence

Overflow the disk I/O buffer

Mon, 30 Jul 2007 18:49:19 Z

Joshua Kasper wrote:

Has there been a resolution to this? I have a similar problem occurring.

And do you have a similar problem, or the exact same problem? Do you have the same error messages?

Overflow the disk I/O buffer

Mon, 30 Jul 2007 18:50:25 Z

SQLChamp wrote:

Column in database is float.

Bytes from the text file range from 1 to 35.6

-Lawrence

What is the data type of the column inside SSIS? Make sure that it is what you expect it to be in all stages of the data flow.

Overflow the disk I/O buffer

Mon, 30 Jul 2007 19:54:04 Z

I doubled check the Data Flow, and they are all float or mapping to the same column name.

Maybe the format of the data in the text file is causing SSIS to fail? Would you know what kind of data in the text file would do that? But I would assume the error log should indicate which row it error out on if it were format issue.

Any other places to check? or would this be random SSIS bug?

-Lawrence

Overflow the disk I/O buffer

Mon, 30 Jul 2007 20:02:24 Z

SQLChamp wrote:

I doubled check the Data Flow, and they are all float or mapping to the same column name.

Any other places to check? or would this be random SSIS bug?

-Lawrence

Well, there isn't a float data type inside a data flow... Can you tell me what SSIS data type you have this column listed as?

Also, if you have a numeric field defined as numeric(4,2) and you have a number such as 1.234, it will fail, strictly speaking. 12.34 works. 123.4 does not.

Overflow the disk I/O buffer

Mon, 30 Jul 2007 21:23:08 Z

FlatFile Metadata for [Avg Position] = DT_R4 (precision=0, length=0)

Float cannot set precision like numeric, so hopefuly precision is not the cause of this SSIS error.

What's weird is that ther are many other columns with Float, and they don't appear to cause any error, but [Avg Position] is at the last column, so not sure if that has an effect.

I am trying to attach the screenshot in this forum, but I am not sure you are able to see it below. Maybe this forum don't support screenshot.

-Lawrence

Overflow the disk I/O buffer

Mon, 30 Jul 2007 21:43:09 Z

Since it's the last field in the file, it could be a row terminator issue.

How do you have the flat file setup? Ragged right? CSV?

Overflow the disk I/O buffer

Mon, 30 Jul 2007 22:20:23 Z

In SSIS, [Avg Position] ColumnDelimiter is set to {CR}-{LF}

Row Delimiter - {CR}-{LF}

How do I check whether my text file source is compatible with the setting above?

-Lawrence

Overflow the disk I/O buffer

Tue, 31 Jul 2007 00:06:04 Z

I think the issue is that there is an extra blank line at the end. This does not happen all the time, so have to accommodate both (end of line & extra line). How would I setup SSIS to accommodate the extra blank line?

Thanks,

-Lawrence

Overflow the disk I/O buffer

Tue, 31 Jul 2007 16:39:38 Z

Locale was set non-Unicode.

I wonder if setting it to Unicode 1252 (Latin 1) would resolve the issue, even though all the column datatype I have set does not have any unicode.

How does SSIS process the end of file (extra blank line VS end of file) compared between (unicode and no unicode)?

-Lawrence

Overflow the disk I/O buffer

Mon, 13 Aug 2007 18:19:13 Z

Hello,

Can anyone offer any tips to resolve extra blank lines at end of the text file?

I am still running into issues whenever there are extra blank lines. Is there a way to accomodate this?

I have to switch back and forth between Unicode setting in the automation.

Appreciated,

-Lawrence

Overflow the disk I/O buffer

Wed, 01 Oct 2008 16:05:00 Z

Is there anyone who solved this issue? I have the same problem with my csv files...

Overflow the disk I/O buffer

Mon, 01 Dec 2008 17:34:09 Z

In your File Connection Manager try to set "Header row delimiter" to {LF} in both General and Columns tab.

Overflow the disk I/O buffer

Tue, 02 Dec 2008 07:02:52 Z

Could you pre-process your file to remove extra blank lines?

Thanks,

Bob

Overflow the disk I/O buffer

Tue, 14 Jul 2009 11:45:08 Z

Hi,

Just stumbled across this forum as I was having the same problem. Don't know if this will help, but my issue came down to the fact that the encoding of the file I was importing had changed from ANSI to Unicode. I changed it back to ANSI and it seemed to work fine.

Hope this helps,

Leo