BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Follow BOB on Twitter! 
Follow BOB on Twitter! (Opens a new window)  

General Notice: No events within the next 45 days.

Open Hub extraction from BW is slow


 
Search this topic... | Search DI: SAP-specific ERP/BW... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: SAP-specific ERP/BW  Previous TopicPrint TopicNext Topic
Author Message
Codehopper
Senior Member
Senior Member



Joined: 14 May 2010

Posts: 86



PostPosted: Thu Dec 15, 2011 11:12 pm 
Post subject: Open Hub extraction from BW is slow

I have a requirement to extract from very large BW DSOs into Data Services 4.0 and further to HANA. For the HANA table I tried to enable bulk loading with a few parallel loaders.

I went by the book and created Open Hub destinations, Process Chains etc. The performance was surprisingly bad, though:

1. The load to Data Services didn't start until Open Hub DTP completed. I guess it's reasonable in order to avoid partial load of the data in case the DTP fails in the middle.

2. The load from Data Services to HANA didn't start until all data has been read from BW -- I checked that using the Batch Job Monitor and polling number of records in HANA. Now, that's quite a surprise, and I wonder if the reason is the same as in #1. Having two points of "all or nothing" doesn't make sense.

Have I missed to make some extra specific tunings? 4 Mio records in 4 hours is soooo 2000-s seeya.gif

Also, a side thought -- with introduction of ODP, all this Open Hub-based extraction kinda loses the point: if ODP was able to work not only with ECC BusinessContent Extractors, but with BW Export DataSources (including customer-specific), wouldn't it be faster and more convenient?
Back to top
Codehopper
Senior Member
Senior Member



Joined: 14 May 2010

Posts: 86



PostPosted: Mon May 28, 2012 6:28 pm 
Post subject: Re: Open Hub extraction from BW is slow

I wonder what sort of a problem this is, that an OSS message for it stays open for three months (0000070312 -- in case an SAP person checks out this message).

P.S. To moder: sorry for bumping this up, I would have not done it if any other channel hadn't been exhausted.
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10591
Location: Germany


flag
PostPosted: Tue May 29, 2012 3:52 pm 
Post subject: Re: Open Hub extraction from BW is slow

The handshake from BW to DataServices is sequentially. BW first writes all the data into the OpenHub Destination table, then DataServices reads from it. But while it is reading it is streaming the data into the target. Otherwise it would pile up in the al_engine memory, that doesn't make sense.
_________________
Werner Daehn
Product Manager Data Services
SAP AG
�The opinions expressed in this post are my own views and not those of SAP.�
Back to top
klo3010
Senior Member
Senior Member



Joined: 03 Aug 2009

Posts: 30
Location: Europe


flag
PostPosted: Fri Jun 08, 2012 5:44 pm 
Post subject: Re: Open Hub extraction from BW is slow

Slow it is indeed.
My customer tries to extract APO (planning) data using the Openhub interface. In the APO-embedded BW they've got a table with approx. 350 million records (including zero-only records). Out of those, 90 million records contain non-zero values to be extracted thru the OpenHub.
The elapsed time of the full extraction job (from DSO thru PSA and Openhub to DS) is more than a day. Annoying when you want to run it at daily frequency, isn't it?
Any recommendations to improve the performance are gratefully appreciated.
Back to top
Ttekcirt
Forum Member
Forum Member



Joined: 04 Jun 2009

Posts: 9
Location: Brussels


flag
PostPosted: Wed Oct 19, 2016 8:53 am 
Post subject: Re: Open Hub extraction from BW is slow

Is this still an ongoing issue?

BW writing data into Open Hub Destination tables is ok.

But the next step is painfully slow : reading & streaming data into target.

We are using BODS 14.2.5
Back to top
Antremons
Forum Associate
Forum Associate



Joined: 21 Mar 2006

Posts: 526



PostPosted: Tue Nov 01, 2016 11:19 am 
Post subject: Re: Open Hub extraction from BW is slow

Best option would be to directly call DSO/InfoProvider through data services using SAP BW Application datastore of Datastore type SAP BW Source
_________________
DWH, BOE/Crystal, DataServices EIM, BEX to WebI/Crystal migration, SAP BPC, SAP BW, Xcelsius, QlikView, SAP HANA.
SAP Associate Certified: BO, WEBI, CRYSTAL, BODI, BOSUP
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: SAP-specific ERP/BW  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0309 seconds using 17 queries. (SQL 0.0033 Parse 0.0009 Other 0.0267)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo