BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Want to sponsor BOB? 
Want to sponsor BOB? (Opens a new window)  

General Notice: BOB is going to retire...please see details here.
General Notice: No events within the next 45 days.

Large XML File generation - Performance Issue


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
mvkreddy15
Forum Member
Forum Member



Joined: 13 May 2015

Posts: 13



PostPosted: Thu May 05, 2016 7:08 am 
Post subject: Large XML File generation - Performance Issue

Hi ,

Has anyone generated large XML files using BODS?

We are trying to generate an XML file from a table having around 3.1 Million records. The job is running for around 1 hour and creating the XML file of size 480 MB. Also when the job running the memory consumption is almost 100%.(Around 16 GB).

We notice no Cartesian products in monitor log.The max number in the monitor log is the number of records in source which is 3.1 Million.

Also another strange thing noticed during job run is ,if we start the job at 9 AM it completes writing to the xml file by 9.30, but the job(dataflow) is running until 10 AM without doing anything. Completely clue less on what it is doing these 30 mins. We don't have the validate xml option checked.

Any suggestions on improving the performance are appreciated.

Thanks
Vams.
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0258 seconds using 17 queries. (SQL 0.0024 Parse 0.0008 Other 0.0226)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo