BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Follow BOB on Twitter! 
Follow BOB on Twitter! (Opens a new window)  

General Notice: No events within the next 45 days.

job performance issue
1 members found this topic helpful

 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
ursfriend77
Principal Member
Principal Member



Joined: 02 Mar 2011

Posts: 163



PostPosted: Thu May 18, 2017 12:11 pm 
Post subject: job performance issue

Hi Exerts,

I have job scheduled everyday. 2 weeks the job was taken 2 hr 30 mins to execute job. since 2 weeks the job has been taking 3 hr 30 mins to load same data.

Please advise me how to improve performance of my job to decrease the time back to 2 hr 30 mins. And let me know what are best options to optimize the performance in BODS 4.2

Appreciate your help

Thanks and Regards,
Venki
Back to top
eganjp
Forum Addict
Forum Addict



Joined: 12 Sep 2007
ASUG Icon
Posts: 4280
Location: Denver Area


flag
PostPosted: Mon May 22, 2017 2:09 pm 
Post subject: Re: job performance issue

The easy way? Hire somebody that is an expert at performance tuning.

The hard way? Examine the monitor log and look for items in it that are taking a long time. Find the objects that take the longest time and start there.

_________________
Jim Egan
ProKarma-an SAP Consulting Partner
Speaker at RMOUG Training Days 2013
Speaker at Sapphire Now 2013
Speaker at Business Objects User Conference 2013
-My ETL is faster than your database! - Advanced ETL performance tuning for Data Services
-Kill ETL bugs before they kill you!
My ETL blog

Latest Blog Posts
• 2014-04-17 Can Your ETL Make Your Reporting Faster?
• 2014-04-04 ProKarma Acquires Mantis Technology Group
• 2014-04-02 How to Create Charts in Webi (Part 2 of 2)
Back to top
aidelia
Principal Member
Principal Member



Joined: 02 Feb 2006

Posts: 336
Location: Rosario, Argentina


flag
PostPosted: Tue May 23, 2017 7:12 am 
Post subject: Re: job performance issue

Hello,

Adding up to Ernie's thoughts, when you got that information, look for the task that have increased the most since the beggining, either by percentage or by absolute time. Usually there be one, two or very few DFs that should be reworked. Sometimes the problem is just a target table heavelly indexed and naturally with more rows since each job run.

But, if the increase is distributed evenly in all the job, then the problem could be just the amount of rows processed are increasing for an external cause.

hope this also helps,

Andrés
Back to top
eepjr24
Forum Enthusiast
Forum Enthusiast



Joined: 16 Sep 2005
ASUG Icon
Posts: 1815
Location: Orlando, FL


flag
PostPosted: Tue May 23, 2017 7:48 am 
Post subject: Re: job performance issue

Andres,

Although Jim and I have both been on here forever, we are different people. =P

I agree with the above, though. Oft times your culprit will be some sort of DB or other external change when you get a sudden jump. Examining the logs can give you an idea of where to look. That all assumes it is not something obvious like a row count increase. Possible suspects are network bandwidth, hardware threshold exceeded (disk thrashing, memory swapped to disk, cpu pegged, etc), indices (dropped, added, not rebuilt), data complexity increase, DB volume fragmentation, etc, etc, etc.

If you aren't comfortable digging in, call an expert, there are plenty available in the market.

- E

_________________
Please Search before you post.
___________________________
Ernie Phelps
Senior Manager
Protiviti
http://www.protiviti.com
Back to top
aidelia
Principal Member
Principal Member



Joined: 02 Feb 2006

Posts: 336
Location: Rosario, Argentina


flag
PostPosted: Tue May 23, 2017 7:55 am 
Post subject: Re: job performance issue

Yeahhh....

Jim and Ernie means the same in Spanish icon_smile.gif

Regards,


Andrés (which means "the one who confuses names")
Back to top
eganjp
Forum Addict
Forum Addict



Joined: 12 Sep 2007
ASUG Icon
Posts: 4280
Location: Denver Area


flag
PostPosted: Tue May 23, 2017 8:09 am 
Post subject: Re: job performance issue

Andrés, no big deal. I've been doing performance tuning for a long time. I have a number of tools I've developed over the years to help me find the objects that need the most attention. I consider Ernie to be a peer, so any answer from him is just as good as one from me.

It's a lot easier to discuss specifics rather than generalities. One very specific tip I give to my developers is to always look at the Display Optimized SQL before you consider a Dataflow "done". If there are multiple queries being executed by the Dataflow then that is usually a red flag. A Dataflow with a Table Comparison that has two queries in the Display Optimized SQL is OK.

Usually, the fewer queries (ideally, only one) a Dataflow submits the faster it executes.

_________________
Jim Egan
ProKarma-an SAP Consulting Partner
Speaker at RMOUG Training Days 2013
Speaker at Sapphire Now 2013
Speaker at Business Objects User Conference 2013
-My ETL is faster than your database! - Advanced ETL performance tuning for Data Services
-Kill ETL bugs before they kill you!
My ETL blog

Latest Blog Posts
• 2014-04-17 Can Your ETL Make Your Reporting Faster?
• 2014-04-04 ProKarma Acquires Mantis Technology Group
• 2014-04-02 How to Create Charts in Webi (Part 2 of 2)
Back to top
aidelia
Principal Member
Principal Member



Joined: 02 Feb 2006

Posts: 336
Location: Rosario, Argentina


flag
PostPosted: Tue May 23, 2017 8:35 am 
Post subject: Re: job performance issue

The good part about developing ETL processes is there are no general recipes, just a bunch of general guidances and a lot of effort and fun.

And also a lot of concepts that could be cross applied to any good ETL tool, so is not so difficult to jump from one to another...

My two cents,

Andrés
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0278 seconds using 17 queries. (SQL 0.0021 Parse 0.0009 Other 0.0248)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo