BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Sunset Ride 
Sunset Ride 

General Notice: BOB is going to retire...please see details here. All BOB forums have been converted to "read only" as of September 1st.
General Notice: No events within the next 45 days.

Error: memoryMonitor - low on process virtual memory


 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
pomtv
Forum Member
Forum Member



Joined: 28 Apr 2005

Posts: 22



PostPosted: Fri May 12, 2006 10:49 am 
Post subject: Error: memoryMonitor - low on process virtual memory

I am getting this error many times. The question is how to configure DI- Job Server so that it can use all the available resources?

We have 6GB memory but DI taking only 2GB, why?
We have 10GB of paging file, DI never uses this virtual memory, why?


Error:
6032 5924 SYS-170114 05-12-06 01:25:17 memoryMonitor
6032 5924 SYS-170114 05-12-06 01:25:17 Your system is running low on process virtual memory Total process virtual memory is <50> Mbytes. Available process virtual
6032 5924 SYS-170114 05-12-06 01:25:17 memory is <> Mbytes.

Thanks in advance..

_________________
POM
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10593
Location: Germany


flag
PostPosted: Fri May 12, 2006 1:47 pm 
Post subject: Re: Error: memoryMonitor - low on process virtual memory

because a 32bit application can address 2GB of memory only.
_________________
Werner Daehn
ex Product Manager Data Services at SAP SE

www.rtdi.io
Back to top
pomtv
Forum Member
Forum Member



Joined: 28 Apr 2005

Posts: 22



PostPosted: Fri May 12, 2006 3:04 pm 
Post subject: Re: Error: memoryMonitor - low on process virtual memory

Thanks for your answer wdaehn.. icon_biggrin.gif
Some jobs need more then 2GB data, how to handle those jobs?

What are the optimum parameters value for the following parameters for ex. to load 5 millions of data? I know it depends on the situation but i need an example to check my jobs performance.

Datastore editor: Rows per commit
Source Table editor: Array fetch size
Target table: Rows per commit

Thanks

_________________
POM
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Fri May 12, 2006 4:38 pm 
Post subject: Re: Error: memoryMonitor - low on process virtual memory

Please search in this forum, this has been asked a few times before.
Back to top
SantoshNirmala
Forum Associate
Forum Associate



Joined: 15 Mar 2006

Posts: 513
Location: Hartford, CT


flag
PostPosted: Fri May 12, 2006 5:03 pm 
Post subject: Re: Error: memoryMonitor - low on process virtual memory

Hi,

In the following the first option can be used for the table when it can fit in to the memory and the later ones depend upon various issues like network you are connected to, memory availability, etc....
Source Table editor: Array fetch size
Datastore editor: Rows per commit
Target table: Rows per commit

Correct/Suggest me if I am wrong.

Regards.
Santosh.
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Fri May 12, 2006 5:08 pm 
Post subject: Re: Error: memoryMonitor - low on process virtual memory

Source Table editor: Array fetch size
Datastore editor: Rows per commit
Target table: Rows per commit


These settings will not materially affect your memory "footprint".

If you have 5 million rows, and each row is 1000 bytes, and it's getting brought entirely into memory, that's 5Gb. Some tips:

- Turn off caching in the source tables
- Avoid outer joins if possible
- Avoid caching any LOOKUP() functions
- Don't bring in columns from your source table that you don't need
- Break apart your dataflow into multiple dataflows that may allow you to avoid the issues above

All of these have performance trade-offs.
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 1 of 1 All times are GMT - 5 Hours
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0284 seconds using 17 queries. (SQL 0.0030 Parse 0.0009 Other 0.0245)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo