BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Launch Works 
Launch Works (Opens a new window)  

General Notice: No events within the next 45 days.

Concurrently processing processing files


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
amhatre
Senior Member
Senior Member



Joined: 07 Feb 2012
ASUG Icon
Posts: 33


flag
PostPosted: Fri Mar 09, 2012 7:13 pm 
Post subject: Concurrently processing processing files

Hi DS experts,

I have two different scenario and would like to understand if there are any DS configuration to do simultaneous processing of files and WebService requests, or will the DS handle it automatically? Are there any limitations in DS with concurrent processing?

1. I have a data flow that waits on file arrival. Upon file arrival in a folder it need to parse it and load it to database. There could be up to 20-30 files arrive at same time. Will the DS process them at same time or sequentially? What are my options to load them in parallel? All files to be loaded to same Target table.

2. In 2nd scenario, upon Webservice request want to make entry into database table.

Thanks,

Abhay
Back to top
dsuser
Forum Member
Forum Member



Joined: 12 Mar 2012

Posts: 1



PostPosted: Mon Mar 12, 2012 5:57 am 
Post subject: Re: Concurrently processing processing files

Hi Abhay,

Solution to the 1st scenario:

If all the files are of same structure, you can create a file format as filename_*(Suppose file names will be like filename_1,Filename_2...etc) and load all the data at a time into target table.

Thanks,
DSUSER
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0096 seconds using 17 queries. (SQL 0.0031 Parse 0.0002 Other 0.0063)
CCBot/2.0 (http://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo