BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Follow BOB on Twitter! 
Follow BOB on Twitter! (Opens a new window)  

General Notice: BOB is going to retire...please see details here.
General Notice: No events within the next 45 days.

SCD2 implementation


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
devika
Forum Member
Forum Member



Joined: 11 Feb 2016

Posts: 1



PostPosted: Thu Feb 11, 2016 1:43 am 
Post subject: SCD2 implementation

Hi Experts,

I am new to BODS,I would like to know if SCD2 can be implemented in a dataflow without using History preserving transform.My TL says using History Preserving Transform in the dataflow will be a bottle neck when the source is having huge volumes of data.Any alternatives for History Preserving Transform.Please advise.

Thanks in advance
Back to top
reddevilme
Senior Member
Senior Member



Joined: 26 Aug 2013

Posts: 37
Location: New Jersey



PostPosted: Wed Mar 02, 2016 1:39 pm 
Post subject: Re: SCD2 implementation

What kind of volume are we talking about here?

There are ways to implement SCD2 without using History_Preserving transform but I am not sure if they would be as efficient.

Instead of using History_Preserving, you can make the updates from Table Comparison (or lookup if you do not plan to compare any columns) as inserts. You can use the same updates to expire the existing records in the target using the Pk/Surrogate Key that you get from TC. You might need to use Transaction control in such cases to avoid table locks.
Back to top
eganjp
Forum Addict
Forum Addict



Joined: 12 Sep 2007
ASUG Icon
Posts: 4280
Location: Denver Area


flag
PostPosted: Wed Mar 02, 2016 9:49 pm 
Post subject: Re: SCD2 implementation

I wouldn't expect the History Preserving transform to add that much overhead. It is not a database operation. Meaning that it doesn't query the database. All it does is turn updates into updates and inserts. That's greatly simplifying what it does but it doesn't really do much.
_________________
Jim Egan
ProKarma-an SAP Consulting Partner
Speaker at RMOUG Training Days 2013
Speaker at Sapphire Now 2013
Speaker at Business Objects User Conference 2013
-My ETL is faster than your database! - Advanced ETL performance tuning for Data Services
-Kill ETL bugs before they kill you!
My ETL blog

Latest Blog Posts
• 2014-04-17 Can Your ETL Make Your Reporting Faster?
• 2014-04-04 ProKarma Acquires Mantis Technology Group
• 2014-04-02 How to Create Charts in Webi (Part 2 of 2)
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0431 seconds using 17 queries. (SQL 0.0180 Parse 0.0013 Other 0.0238)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo