BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Follow BOB on Twitter! 
Follow BOB on Twitter! (Opens a new window)  

General Notice: BOB is going to retire...please see details here.
General Notice: No events within the next 45 days.

Improving performance-Joining two flat files


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
raja.m6
Forum Member
Forum Member



Joined: 22 Oct 2015

Posts: 1



PostPosted: Thu Oct 22, 2015 12:52 pm 
Post subject: Improving performance-Joining two flat files

I'm a newbie to SAP BODS. We have a scenario, where we are joining two flat files to get single column. Both Primary and Reference file records were suppose to be in millions. We don't have any staging DB to push down to sql operations.

In this case, is it better to go for JOIN or LOOK UP? Is there is any other way to improve performance other than staging DB?

Thanks
Back to top
H. Westerhof
Senior Member
Senior Member



Joined: 26 Mar 2010

Posts: 65
Location: Groningen


flag
PostPosted: Thu Nov 12, 2015 2:44 am 
Post subject: Re: Improving performance-Joining two flat files

Why don't you have a staging area?

Another alternative is to use two Data Transfer objects to load the data and then join the both outcomes.

You can decide to leave the data transfers on automatic, but even better is to use a database for that purpose. A simple SQL Anywhere database will work, you could even use the repository database for that matter.
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0295 seconds using 17 queries. (SQL 0.0030 Parse 0.0008 Other 0.0257)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo