Prev: Log dump when opening work datasets
Next: Grammar for the SAS language?
From: xav on 9 Feb 2010 04:55
Hello,

I'm adding more than 4M records to an indexed dataset (primary key)

here is the log, note the amount of memory used : 241k, and the time
14 minutes

NOTE: Appending WORK.TMP_SIM_COMP_VALUES to CES0005.SIM_COMP_VALUES.
NOTE: There were 4266560 observations read from the data set
WORK.TMP_SIM_COMP_VALUES.
NOTE: 4266560 observations added.
NOTE: The data set CES0005.SIM_COMP_VALUES has 4266560 observations
and 8 variables.
NOTE: PROCEDURE APPEND used (Total process time):
real time 14:27.48
user cpu time 1:02.35
system cpu time 3:24.38
Memory 241k
Page Faults 1250487
Page Reclaims 19058
Page Swaps 0
Voluntary Context Switches 88747
Involuntary Context Switches 116867
Block Input Operations 0
Block Output Operations 0

I'm trying to optimize the load, so I m using the same dataset (4M
records) and now the memory is much more important : 416256k and the
time divided by 35 !

Log:

NOTE: PROCEDURE APPEND used (Total process time):
real time 25.23 seconds
user cpu time 17.99 seconds
system cpu time 12.48 seconds
Memory 416256k
Page Faults 8
Page Reclaims 375108
Page Swaps 0
Voluntary Context Switches 46855
Involuntary Context Switches 2479
Block Input Operations 0
Block Output Operations 0

It's like memory can not be used in the first test.

Before that append statement, SAS can address :
Line 5923: Memory 415790k
Line 162780: Memory 104504k
Line 162867: APPEND Statement

In test2 it just a snippet of code with the same data (retrieved from
fs)

Is SAS can not release memory?

xav
 | 
Pages: 1
Prev: Log dump when opening work datasets
Next: Grammar for the SAS language?