Prev: proc expand with a twist
Next: Russian Characters in SAS
From: jaheuk on 7 Jun 2010 06:34
hi folks,
has someone experience to perform slowly changing dims type 2 on
mainframe?
I have found a macro with this function but it takes 6 hours for
process 180.000 recs!!

Regards,
Herman
From: Patrick on 7 Jun 2010 06:53
Hi

Loading a table using SCD2 is performance intensive - but 6 hours
sounds like too much especially on a mainframe.

The question is: Where is your database located? Could it be that this
macro first reads all records from the DB into SAS? That could explain
some of the time used.

I've lately used a lot of SCD2 loading (Windows and Unix) with
millions of records and wide tables. Performance was a challenge but
it never came close to 6 hours.

What macro are you using? And where did you find it? It might be worth
to have people have a look into it.

If you've got a lot of ETL tasks with SAS then it might be worth to
investigate if purchasing SAS DI Studio would be an option. There is
also an SCD2 loader in it. The one provided with the newest SAS DIS
version is quite good.

HTH
Patrick
 | 
Pages: 1
Prev: proc expand with a twist
Next: Russian Characters in SAS