Proc summary error:
in [SAS]
|
Prev: How to read date time hour second value
Next: Enterprise Guide 4.1/SAS 9.1.3 - How to disable LIBNAME statement
From: Amar Mundankar on 2 Jun 2010 06:26 Hi All, My input dataset has 2067090 records and 96 COLUMNS. I am doing proc summary on that dataset. I am getting following error. Please help. This error is hampering my work. I am not able to do anything. Thanks in advance. ERROR: PROC SUMMARY was terminated prematurely due to a memory shortage. Adjusting MEMSIZE and/or SUMSIZE may allow normal +38243 processing to complete. +38244 NOTE: The initial memory limit for classification tables was 100096K bytes. Actual memory acquired was 99328K bytes. +38245 NOTE: The SAS System stopped processing this step because of insufficient memory. +38246 NOTE: SAS set option OBS=0 and will continue to check statements. This may cause NOTE: No observations in data set. +38247 NOTE: There were 2067090 observations read from the data set SD2.EXR_PCC_MONTHLY. +38248 WARNING: The data set SD2.EXR_PCC_OU_DOCSUM may be incomplete. When this step was stopped there were 0 observations and 93 +38249 variables. +38250 WARNING: Data set SD2.EXR_PCC_OU_DOCSUM was not replaced because this step was stopped. +38251 NOTE: PROCEDURE SUMMARY used (Total process time): +38252 real time 37.01 seconds +38253 cpu time 1:28.04 Regards, Amar Mundankar.
From: data _null_; on 2 Jun 2010 07:50 On Jun 2, 5:26 am, Amar Mundankar <amarmundan...(a)gmail.com> wrote: > Hi All, > My input dataset has 2067090 records and 96 COLUMNS. > I am doing proc summary on that dataset. I am getting following > error. > Please help. This error is hampering my work. I am not able to do > anything. > Thanks in advance. > > ERROR: PROC SUMMARY was terminated prematurely due to a memory > shortage. Adjusting MEMSIZE and/or SUMSIZE may allow normal > +38243 processing to complete. > +38244 NOTE: The initial memory limit for classification tables was > 100096K bytes. Actual memory acquired was 99328K bytes. > +38245 NOTE: The SAS System stopped processing this step because of > insufficient memory. > +38246 NOTE: SAS set option OBS=0 and will continue to check > statements. This may cause NOTE: No observations in data set. > +38247 NOTE: There were 2067090 observations read from the data set > SD2.EXR_PCC_MONTHLY. > +38248 WARNING: The data set SD2.EXR_PCC_OU_DOCSUM may be > incomplete. When this step was stopped there were 0 observations and > 93 > +38249 variables. > +38250 WARNING: Data set SD2.EXR_PCC_OU_DOCSUM was not replaced > because this step was stopped. > +38251 NOTE: PROCEDURE SUMMARY used (Total process time): > +38252 real time 37.01 seconds > +38253 cpu time 1:28.04 > > Regards, > Amar Mundankar. You need to show some code. But I suspect you have too many CLASS variables or are asking for too many combinations of those class variables. Look a TYPES and or WAYS statements to reduce the number of class variable combinations you are requesting.
From: Lou on 2 Jun 2010 08:44
"Amar Mundankar" <amarmundankar(a)gmail.com> wrote in message news:b496d954-2954-49c5-94da-e0ee87c35c71(a)z33g2000vbb.googlegroups.com... > Hi All, > My input dataset has 2067090 records and 96 COLUMNS. > I am doing proc summary on that dataset. I am getting following > error. > Please help. This error is hampering my work. I am not able to do > anything. > Thanks in advance. > > ERROR: PROC SUMMARY was terminated prematurely due to a memory > shortage. Adjusting MEMSIZE and/or SUMSIZE may allow normal > +38243 processing to complete. > +38244 NOTE: The initial memory limit for classification tables was > 100096K bytes. Actual memory acquired was 99328K bytes. > +38245 NOTE: The SAS System stopped processing this step because of > insufficient memory. > +38246 NOTE: SAS set option OBS=0 and will continue to check > statements. This may cause NOTE: No observations in data set. > +38247 NOTE: There were 2067090 observations read from the data set > SD2.EXR_PCC_MONTHLY. > +38248 WARNING: The data set SD2.EXR_PCC_OU_DOCSUM may be > incomplete. When this step was stopped there were 0 observations and > 93 > +38249 variables. > +38250 WARNING: Data set SD2.EXR_PCC_OU_DOCSUM was not replaced > because this step was stopped. > +38251 NOTE: PROCEDURE SUMMARY used (Total process time): > +38252 real time 37.01 seconds > +38253 cpu time 1:28.04 > > Without any sample code, it's impossible to tell what you're trying to do, but perhaps you could try BY processing instead of using a CLASS statement. BY processing requires you to sort the data set first, but uses far less memory. |