Improving performance-Joining two flat files

[raja.m6]

I'm a newbie to SAP BODS. We have a scenario, where we are joining two flat files to get single column. Both Primary and Reference file records were suppose to be in millions. We don't have any staging DB to push down to sql operations.

In this case, is it better to go for JOIN or LOOK UP? Is there is any other way to improve performance other than staging DB?

Thanks

[H. Westerhof]

Why don't you have a staging area?

Another alternative is to use two Data Transfer objects to load the data and then join the both outcomes.

You can decide to leave the data transfers on automatic, but even better is to use a database for that purpose. A simple SQL Anywhere database will work, you could even use the repository database for that matter.