BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Sunset Ride 
Sunset Ride 

General Notice: BOB is going to retire...please see details here. All BOB forums have been converted to "read only" as of September 1st.
General Notice: No events within the next 45 days.

Benchmark YOUR hardware and compare the results V1.1
1 members found this topic helpful
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10  Next
 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
data_guy
Forum Associate
Forum Associate



Joined: 19 Aug 2006
ASUG Icon
Posts: 723
Location: Somewhere EveryWhere!


flag
PostPosted: Tue Oct 28, 2008 12:35 pm 
Post subject: Benchmark YOUR hardware and compare the results

This is me again, DATA_GUY!

Below are the statistics from our Development Box:

DI 11.7.2 Designer: Intel Core 2 CPU 6400 @ 2.13 GHZ, 2 GB RAM, WIN XP Prof Ver 2002 SP2

Database server has oracle database 10G (10.2.0.3) installed (SOURCE and TARGET DB ARE SAME)


JOB SERVER:
Processors : Two Dual-Core Intel Xeon® 5140 2.33 GHZ
Cache size : 4096 KB
Memory Total : 16633492 kB
O.S: : Linux version 2.6.9-42.0.8

Process to execute data flow <DF_Benchmark_read> is completed.
Time______________________________ 80 secounds

Process to execute data flow <DF_Benchmark_API_bulkloader> is completed.
Time______________________________ 393 secounds

Process to execute data flow <DF_Benchmark_regular_load> is completed.
Time______________________________ 1026 secounds

process to execute data flow <DF_Benchmark_single_thread> is completed.
Time______________________________ 22 secounds

Process to execute data flow <DF_Benchmark_lookup_DOP1> is completed.
Time______________________________ 105 secounds

Process to execute data flow <DF_Benchmark_lookup_DOP10> is completed.
Time______________________________ 78 secounds


Danke,

_________________
@Data is Delicious

++++++++++++++++
Where you see risk,
I see opportunity!


Last edited by data_guy on Fri Jan 30, 2009 1:46 pm, edited 2 times in total
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Tue Oct 28, 2008 5:27 pm 
Post subject: Re: Benchmark YOUR hardware and compare the results

Test with new SAN and DI 11.7.3.5 - Source, Target, and DI on same server

Source: MS SQL 2005

Single Server: Win2003 r2 SP1 x64, (2) 2.8Ghz AMD CPUs (dualcore), 32GB RAM, RAID 10 on many SAN spindles

DI Server: Same as above

Network, source to DI: n/a

DI Version: 11.7.3.5

Network, DI to Target: n/a

Target db: MS SQL 2005 (different db, different SAN spindles)

Target server: Same as above

Results

<DF_Benchmark_read_MS>: 112 seconds
<DF_Benchmark_API_bulkloader_MS>: 298 seconds
<DF_Benchmark_regular_load_MS>: 260 seconds
<DF_Benchmark_single_thread_MS>: 22 seconds
<DF_Benchmark_lookup_DOP1_MS>: 79 seconds
<DF_Benchmark_lookup_DOP10_MS>: 328 seconds


This last item (328 seconds) was pretty bad, but in previous testing I've found by forcing the dataflow to In-Memory (vs. Pageable), the test runs much quicker. So I made that change, and the results were:

<DF_Benchmark_read_MS>: 116 seconds
<DF_Benchmark_API_bulkloader_MS>: 308 seconds
<DF_Benchmark_regular_load_MS>: 278 seconds
<DF_Benchmark_single_thread_MS>: 24 seconds
<DF_Benchmark_lookup_DOP1_MS>: 46 seconds
<DF_Benchmark_lookup_DOP10_MS>: 15 seconds


The last two tests were better; the DOP10 one dramatically so. I think I'm one of the few Win2003 64-bit users who have posted the results, and am convinced it is related to that.


Last edited by dnewton on Wed Oct 29, 2008 7:21 am, edited 1 time in total
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Tue Oct 28, 2008 5:53 pm 
Post subject: Re: Benchmark YOUR hardware and compare the results

Attached is a spreadsheet with a table of the results to date.

Items in green are the best results of the bunch; items in yellow are the worst.
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10593
Location: Germany


flag
PostPosted: Thu Nov 13, 2008 6:39 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

gpn01 wrote:
Hi, any chance of the statistics summary page being updated ? Maybe a neat little graph comparing results too ?



Just-in-time means something different, but now, just half a year later, I have updated the list. Sorry for that.


EDIT: I tried to come up with diagrams, none made sense.

_________________
Werner Daehn
ex Product Manager Data Services at SAP SE

www.rtdi.io


Last edited by Werner Daehn on Thu Nov 13, 2008 10:52 am, edited 2 times in total
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10593
Location: Germany


flag
PostPosted: Thu Nov 13, 2008 10:24 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

Data_Guy wrote:
This is me again, DATA_GUY!

process to execute data flow <DF_Benchmark_single_thread> is completed.
Time______________________________ 297 secounds



That can't be right!!!

_________________
Werner Daehn
ex Product Manager Data Services at SAP SE

www.rtdi.io
Back to top
grannesh
Forum Member
Forum Member



Joined: 21 Sep 2007

Posts: 24


flag
PostPosted: Wed Dec 03, 2008 4:24 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

Source: MS SQL 2005 64 bit
Win2003 r2 x64, 16 CPU, 64 GB RAM.

DI Server: Win2003 on VmWare. 2 CPU. 3 Gb RAM.
Network, source to DI: n/a

DI Version: 12.1.0.0

Network, DI to Target: n/a

Target db: Same as Source DB.

Target server: Same as above


BODI 12.1.
Prod-Prod (2 cpu bodiserver)

Process to execute data flow <DF_Benchmark_read_MS> is completed.
Time______________________________ 255 secounds
Process to execute data flow <DF_Benchmark_API_bulkloader_MS> is completed.
Time______________________________ 441 secounds
Process to execute data flow <DF_Benchmark_regular_load_MS> is completed.
Time______________________________ 289 secounds
Process to execute data flow <DF_Benchmark_single_thread_MS> is completed.
Time______________________________ 15 secounds
Process to execute data flow <DF_Benchmark_lookup_DOP1_MS> is completed.
Time______________________________ 81 secounds
Process to execute data flow <DF_Benchmark_lookup_DOP10_MS> is completed.
Time______________________________ 67 secounds
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10593
Location: Germany


flag
PostPosted: Wed Dec 03, 2008 6:11 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

How many GHz has the CPU?

I have updated the Results page.

Can anybody read something out of the results already? like the impact of VMWare or not??

_________________
Werner Daehn
ex Product Manager Data Services at SAP SE

www.rtdi.io
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Wed Dec 03, 2008 8:14 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

grannesh, can you clarify:

- You are running source, target, and DI all on the same single VM instance (guest OS)?

- Is that guest VM OS 32-bit or 64-bit?

- Is the underlying physical server 16 CPUs and 64Gb RAM? If so, how many CPUs and how much RAM is being presented or used by the VM?

thanks
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10593
Location: Germany


flag
PostPosted: Wed Dec 03, 2008 8:47 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

My understanding was one Server with SQL Server installed. And this server also hosts a 2CPU image inside which DI is executed. I am correct?
_________________
Werner Daehn
ex Product Manager Data Services at SAP SE

www.rtdi.io
Back to top
grannesh
Forum Member
Forum Member



Joined: 21 Sep 2007

Posts: 24


flag
PostPosted: Thu Dec 04, 2008 4:23 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

grannesh, can you clarify:

- You are running source, target, and DI all on the same single VM instance (guest OS)?

Source and Target DB:
The Target and Source Database are on a server cluster with 16 CPUs and 64 Gb of ram. No VmWare. SQL Server 2005 only on Windows 2003 x64. CPUs are Intel Xeon 2.93Ghz.

DI runs on VmWare on a separate VMWare cluster hosting Win2003 Std.ed. x32.
Allocated 2 CPUs and 3 Gb ram. Speed 2.4 Ghz.
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Thu Dec 04, 2008 7:39 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

I am desperate to find someone to do a test on a win64 platform instead of 32-bit. icon_smile.gif

I don't see any patterns in the results, relative to VMware. So VMware is either not an factor, good or bad, or, there are so many other variables (OS, VMware config, underlying hardware, Database, disk) that there's just not enough data to draw a conclusion.
Back to top
PCL
Forum Member
Forum Member



Joined: 25 Jun 2008

Posts: 5
Location: Netherlands


flag
PostPosted: Thu Dec 11, 2008 5:39 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

Name of the Test: DI BENCHMARK
Source: MS SQL 2005
Network source to DI: 1GBit Ethernet

DI server: Windows 2003SP2 32bit / 4 CPU(VMWare)
Jobserver: Windows 2003sp2 32bit / 2 CPU(VMware)
DI: 11.7

Target: MS SQL 2005
Target server: 64bits / 16 Gb /8 CPU / iSCSI-san

11-12-2008 9:48:07 Current system configuration : <AEBDBS>.
11-12-2008 9:48:07 Reading job <069f43f0_bc6f_4434_9b49_8d0d6b2b451c> from the repository; Server version is <11.7.3.3>; Repository version is
11-12-2008 9:48:07 <11.7.0.0000>.
11-12-2008 9:48:07 Current directory of job <069f43f0_bc6f_4434_9b49_8d0d6b2b451c> is <C:\Program Files\Business Objects\Data Integrator 11.7\bin>.
11-12-2008 9:48:07 Starting job on job server host <AEBBOJS>, port <3500>.
11-12-2008 9:48:07 Job <Job_Benchmark_MS> of runid <2008121109480729201868> is initiated by user <boserviceaccount>.
11-12-2008 9:48:07 Processing job <Job_Benchmark_MS>.
11-12-2008 9:48:15 Optimizing job <Job_Benchmark_MS>.
11-12-2008 9:48:16 Job <Job_Benchmark_MS> is started.

DATAFLOW 11-12-2008 9:48:27 Data flow <DF_Benchmark_read_MS> is started.
DATAFLOW 11-12-2008 10:19:01 Process to execute data flow <DF_Benchmark_read_MS> is completed.
PRINTFN 11-12-2008 10:19:02 Time______________________________ 1838 secounds

DATAFLOW 11-12-2008 10:19:02 Process to execute data flow <DF_Benchmark_API_bulkloader_MS> is started.
DATAFLOW 11-12-2008 11:02:41 Process to execute data flow <DF_Benchmark_API_bulkloader_MS> is completed.
PRINTFN 11-12-2008 11:02:41 Time______________________________ 2619 secounds

DATAFLOW 11-12-2008 11:02:47 Process to execute data flow <DF_Benchmark_regular_load_MS> is started.
DATAFLOW 11-12-2008 11:09:42 Process to execute data flow <DF_Benchmark_regular_load_MS> is completed.
PRINTFN 11-12-2008 11:09:42 Time______________________________ 420 secounds

DATAFLOW 11-12-2008 11:09:42 Process to execute data flow <DF_Benchmark_single_thread_MS> is started.
DATAFLOW 11-12-2008 11:09:59 Process to execute data flow <DF_Benchmark_single_thread_MS> is completed.
PRINTFN 11-12-2008 11:10:00 Time______________________________ 17 secounds

DATAFLOW 11-12-2008 11:10:00 Process to execute data flow <DF_Benchmark_lookup_DOP1_MS> is started.
DATAFLOW 11-12-2008 11:11:02 Process to execute data flow <DF_Benchmark_lookup_DOP1_MS> is completed.
PRINTFN 11-12-2008 11:11:02 Time______________________________ 62 secounds

DATAFLOW 11-12-2008 11:11:02 Process to execute data flow <DF_Benchmark_lookup_DOP10_MS> is started.
DATAFLOW 11-12-2008 11:14:53 Process to execute data flow <DF_Benchmark_lookup_DOP10_MS> is completed.
PRINTFN 11-12-2008 11:14:53 Time______________________________ 230 secounds

JOB 11-12-2008 11:14:53 Job <Job_Benchmark_MS> is completed successfully.

Please inform or explain or (preferrably HELP) me about the high processing time for the steps DF_Benchmark_read_MS and DF_Benchmark_API_bulkloader_MS.


Last edited by PCL on Thu Dec 11, 2008 7:40 am, edited 1 time in total
Back to top
dnewton
Forum Addict
Forum Addict



Joined: 30 Jan 2004
ASUG Icon
Posts: 3446
Location: Massachusetts, USA


flag
PostPosted: Thu Dec 11, 2008 7:07 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

PCL, can you clarify please:

- You said the DI and Target are shared
- But the DI is 32-bit Windows and the target is 64-bit windows

So are these truly running under the same Windows instance? Or are you saying the source and target databases are on the same instance?
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10593
Location: Germany


flag
PostPosted: Thu Dec 11, 2008 7:11 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

Is the monitor sample rate set to 64000? Virus scanner?

Edit:

The single-threaded test shows good results so monitor sample rate was set to 64000.

One thing I'd like you to try is editing the source and target datastore, create a new datastore condifuration (advanced -> confisurations) and create a new one for SQL Server 2005. Same user name, same database just the version is different. And this new configuration you make default. I have the feeling this could make a difference.

_________________
Werner Daehn
ex Product Manager Data Services at SAP SE

www.rtdi.io
Back to top
PCL
Forum Member
Forum Member



Joined: 25 Jun 2008

Posts: 5
Location: Netherlands


flag
PostPosted: Thu Dec 11, 2008 7:44 am 
Post subject: Re: Benchmark YOUR hardware and compare the results

Dnewton,

I have changed my data, because DI and SQL are seperate servers and only SQL is 64-bits.

So are these truly running under the same Windows instance? Or are you saying the source and target databases are on the same instance?
Source and target databases are on the same server and are seperate databases.
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 4 of 10 All times are GMT - 5 Hours
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10  Next
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0962 seconds using 17 queries. (SQL 0.0022 Parse 0.0654 Other 0.0286)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo