BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Sunset Ride 
Sunset Ride 

General Notice: BOB is going to retire...please see details here. All BOB forums have been converted to "read only" as of September 1st.
General Notice: No events within the next 45 days.

Data Flow Execution Times


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
dwhitten
Forum Member
Forum Member



Joined: 02 Feb 2006

Posts: 9



PostPosted: Mon Feb 06, 2006 10:32 am 
Post subject: Data Flow Execution Times

I have a question about a data flow execution time I am seeing in the Metadata Reporting application. I have a dataflow which, according to the trace log, took 50 minutes to complete:

2006-02-05 00:45:05 0:00:01 (24141:0001) DATAFLOW : Data flow <DF_CML_TA_LINK_DL_ST> is started.
2006-02-05 01:36:02 0:50:57 (24141:0001) DATAFLOW : Data flow <DF_CML_TA_LINK_DL_ST> is completed successfully.


However,in the Metadata Reporting application I see the following:

Data Flow Name Start Time Execution Time (sec) Extract Rate (rows/sec) Load Rate (rows/sec)
DF_CML_TA_LINK_DL_ST 2006.02.05 01:35:48 0 19278854 19278854


The execution time is zero but it shows a large number of records being processed. Looking at the Optimized SQL I see that the logic is being pushed down to the Oracle DB as a single INSERT-SELECT statement. Does this mean that the timing in the Metadata Reporting application does not include this type of processing? Is there some other explaination for this descrepancy? Thanks in advance for your response.

Dave
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10593
Location: Germany


flag
PostPosted: Mon Feb 06, 2006 10:56 am 
Post subject: Re: Data Flow Execution Times

icon_question.gif icon_question.gif icon_question.gif

DI *should* deal with that case but never had an example...

_________________
Werner Daehn
ex Product Manager Data Services at SAP SE

www.rtdi.io
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Mon Feb 06, 2006 12:42 pm 
Post subject: Re: Data Flow Execution Times

I have seen the same issue - if the dataflow gets pushed down to a single "insert into... select from" statement, the stastics aren't always collected reliably.
Back to top
SantoshNirmala
Forum Associate
Forum Associate



Joined: 15 Mar 2006

Posts: 513
Location: Hartford, CT


flag
PostPosted: Thu Apr 20, 2006 8:03 am 
Post subject: Re: Data Flow Execution Times

hi,

we need to consider absolute time, as the execution time is concerned with the execution on Job Server.

regards.
Kumar.
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0276 seconds using 17 queries. (SQL 0.0021 Parse 0.0009 Other 0.0247)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo