BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Follow BOB on Twitter! 
Follow BOB on Twitter! (Opens a new window)  

General Notice: BOB is going to retire...please see details here.
General Notice: No events within the next 45 days.

BODS 3.2 SQL transform with bulk load API takes forever


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
Smarty
Forum Member
Forum Member



Joined: 12 May 2008

Posts: 23


flag
PostPosted: Tue Jul 07, 2015 9:12 pm 
Post subject: BODS 3.2 SQL transform with bulk load API takes forever

I have a data flow that has sql transform with bulk load API, however this DF takes forever to load 300k records. The monitor log says status READY after 10 hours it loads data fine. I have checked Data service performance monitor and data base sql/session monitor there is nothing unusual.

Please let me know what might be causing this issue?


/thanks

Smarty
Back to top
eganjp
Forum Addict
Forum Addict



Joined: 12 Sep 2007
ASUG Icon
Posts: 4280
Location: Denver Area


flag
PostPosted: Mon Jul 13, 2015 2:46 pm 
Post subject: Re: BODS 3.2 SQL transform with bulk load API takes forever

How many rows are there already in the target table?

Are you sure that it is the target table that is the problem? To rule out the target table put a map_operation before the target table and discard all operation types.

_________________
Jim Egan
ProKarma-an SAP Consulting Partner
Speaker at RMOUG Training Days 2013
Speaker at Sapphire Now 2013
Speaker at Business Objects User Conference 2013
-My ETL is faster than your database! - Advanced ETL performance tuning for Data Services
-Kill ETL bugs before they kill you!
My ETL blog

Latest Blog Posts
• 2014-04-17 Can Your ETL Make Your Reporting Faster?
• 2014-04-04 ProKarma Acquires Mantis Technology Group
• 2014-04-02 How to Create Charts in Webi (Part 2 of 2)
Back to top
amuh10
Principal Member
Principal Member



Joined: 11 Apr 2012
ASUG Icon
Posts: 108


flag
PostPosted: Fri Jul 24, 2015 9:32 am 
Post subject: Re: BODS 3.2 SQL transform with bulk load API takes forever

If the Monitor log says READY, that means the SQL is seems push down to the SQL level. So my understanding is that you have a issue with your joins, as 300k records should not 10 hours to load.
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0270 seconds using 17 queries. (SQL 0.0027 Parse 0.0008 Other 0.0235)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo