BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Want to sponsor BOB? 
Want to sponsor BOB? (Opens a new window)  

General Notice: No events within the next 45 days.

Regarding performance of custom functions.


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
jmuthukumaran
Senior Member
Senior Member



Joined: 13 Sep 2011

Posts: 57


flag
PostPosted: Tue Feb 14, 2017 2:13 pm 
Post subject: Regarding performance of custom functions.

Hi Team,

I have a dataflow which is having 12 custom functions each custom function will run 3 times for an attribute with different input parameters , i have 15 attributes which call these custom functions, function has sql statements inside it. All functions have "enable parallel execution " enabled.The performance of the Job is for 3000 records it is taking 3.5 hours.Then i applied DOP =5 and loader =5 it gave good improvement and it is now taking 1.5 hours but still management is not happy about the throughput and i explained them everything no luck.Is there any way , i can improve the performance further,


Server details :
OS:Windows
RAM-32GB
CPU-8
Back to top
eepjr24
Forum Enthusiast
Forum Enthusiast



Joined: 16 Sep 2005
ASUG Icon
Posts: 1815
Location: Orlando, FL


flag
PostPosted: Wed Feb 15, 2017 7:51 pm 
Post subject: Re: Regarding performance of custom functions.

Use DB functions instead of DS functions when you are calling SQL. You can import the database functions via the data store. That should help greatly.

Alternatively, get rid of the SQL() functions altogether and use a combination dataflows and lookup_ext with custom SQL as a replacement.

- E

_________________
Please Search before you post.
___________________________
Ernie Phelps
Senior Manager
Protiviti
http://www.protiviti.com
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0270 seconds using 17 queries. (SQL 0.0025 Parse 0.0008 Other 0.0237)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo