From: Kulpreet Khanna on
Hi,
I have a 4GB dataset saved on my hard disk in C drive.
I need to remove duplicate records from it and storing the dataset in
work library.
My work library has a free space of 22GB but still, I am gettin an
error while running the code.
It processes half of the observations and then gives an error that the
file is full.
Please suggest.

Thanks
From: Arthur Tabachneck on
Kulpreet,

I think that someone will be more likely to help if you post both your
code and the resulting log.

Art
------
On Mon, 4 Jan 2010 21:09:12 -0800, Kulpreet Khanna
<kulpreetkhanna(a)GMAIL.COM> wrote:

>Hi,
>I have a 4GB dataset saved on my hard disk in C drive.
>I need to remove duplicate records from it and storing the dataset in
>work library.
>My work library has a free space of 22GB but still, I am gettin an
>error while running the code.
>It processes half of the observations and then gives an error that the
>file is full.
>Please suggest.
>
>Thanks
From: S=?ISO-8859-1?Q?=C3=B8ren?= Lassen on
This sounds a bit like a problem I once had. Am I right in
guessing that you are running SAS with the option COMPRESS=YES,
and that your program crashes during PROC SORT?

PROC SORT does have a problem because it has to create some
work copies of the data being sorted (two, I think), and it
is not able to compress those copies.

One solution is to use the TAGSORT option in PROC SORT,
this will slow down the procedure, but it will use a lot less space.

If this does not solve your problem, you will have to post a more
specific message about the problem.

Regards,
Søren

On Mon, 4 Jan 2010 21:09:12 -0800, Kulpreet Khanna
<kulpreetkhanna(a)GMAIL.COM> wrote:

>Hi,
>I have a 4GB dataset saved on my hard disk in C drive.
>I need to remove duplicate records from it and storing the dataset in
>work library.
>My work library has a free space of 22GB but still, I am gettin an
>error while running the code.
>It processes half of the observations and then gives an error that the
>file is full.
>Please suggest.
>
>Thanks