BOB: Business Objects Board
Not endorsed by or affiliated with SAP

Register | Login 

Follow BOB on Twitter! 
Follow BOB on Twitter! (Opens a new window)  

General Notice: No events within the next 45 days.

Benchmark YOUR hardware and compare the results V1.1
1 members found this topic helpful
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10
 
Search this topic... | Search DI: Performance and Tuning... | Search Box
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Author Message
mtelling
Senior Member
Senior Member



Joined: 23 Jun 2006

Posts: 62


flag
PostPosted: Wed Oct 03, 2012 2:44 pm 
Post subject: Re: Benchmark YOUR hardware and compare the results V1.1

Name of the Test: VMWare
Source: Oracle 11g
Network source to DI: 10MBit Ethernet
DI server: Red Hat Ent Linux 5.8 64bit /4 CPU Xeon @2,93 GHz 16GB (VMWare)
DI: 12.2.2.3
Target: Oracle 11g

Code:
(12.2) 10-03-12 21:03:43 (23928:3002520240) DATAFLOW: Process to execute data flow <DF_Benchmark_read> is completed.
(12.2) 10-03-12 21:03:43 (23905:206135984)  PRINTFN: Time______________________________ 30 secounds
(12.2) 10-03-12 21:03:44 (24017:2291507888) DATAFLOW: Process to execute data flow <DF_Benchmark_API_bulkloader> is started.
(12.2) 10-03-12 21:03:45 (24017:2291507888) DATAFLOW: Data flow <DF_Benchmark_API_bulkloader> is started.
(12.2) 10-03-12 21:03:45 (24017:2291507888) DATAFLOW: Data flow <DF_Benchmark_API_bulkloader> using IN MEMORY Cache.
(12.2) 10-03-12 21:03:47 (24017:1138747712) BLKLDAPI: Starting Bulk Loader API in <Dataflow DF_Benchmark_API_bulkloader; 4096>.
(12.2) 10-03-12 21:06:05 (24017:1138747712) BLKLDAPI: Bulk Loader API in <Dataflow DF_Benchmark_API_bulkloader>  completed successfully.
(12.2) 10-03-12 21:06:05 (24017:2291507888) DATAFLOW: Data flow <DF_Benchmark_API_bulkloader> is completed successfully.
(12.2) 10-03-12 21:06:05 (24017:2291507888) DATAFLOW: Process to execute data flow <DF_Benchmark_API_bulkloader> is completed.
(12.2) 10-03-12 21:06:05 (23905:206135984)  PRINTFN: Time______________________________ 141 secounds
(12.2) 10-03-12 21:06:05 (23905:206135984)  PRINTFN: truncating target table via sql() function ...
(12.2) 10-03-12 21:06:06 (23905:206135984)  PRINTFN: truncating target table via sql() function ...done
(12.2) 10-03-12 21:06:07 (24619:512504496) DATAFLOW: Process to execute data flow <DF_Benchmark_regular_load> is started.
(12.2) 10-03-12 21:06:07 (24619:512504496) DATAFLOW: Data flow <DF_Benchmark_regular_load> is started.
(12.2) 10-03-12 21:06:07 (24619:512504496) DATAFLOW: Data flow <DF_Benchmark_regular_load> using IN MEMORY Cache.
(12.2) 10-03-12 21:12:35 (24619:512504496) DATAFLOW: Data flow <DF_Benchmark_regular_load> is completed successfully.
(12.2) 10-03-12 21:12:35 (24619:512504496) DATAFLOW: Process to execute data flow <DF_Benchmark_regular_load> is completed.
(12.2) 10-03-12 21:12:35 (23905:206135984)  PRINTFN: Time______________________________ 388 secounds
(12.2) 10-03-12 21:12:35 (23905:206135984)  PRINTFN: truncating target table via sql() function ...
(12.2) 10-03-12 21:12:49 (23905:206135984)  PRINTFN: truncating target table via sql() function ...done
(12.2) 10-03-12 21:12:50 (26292:3486270128) DATAFLOW: Process to execute data flow <DF_Benchmark_single_thread> is started.
(12.2) 10-03-12 21:12:50 (26292:3486270128) DATAFLOW: Data flow <DF_Benchmark_single_thread> is started.
(12.2) 10-03-12 21:12:50 (26292:3486270128) DATAFLOW: Data flow <DF_Benchmark_single_thread> using IN MEMORY Cache.
(12.2) 10-03-12 21:12:57 (26292:3486270128) DATAFLOW: Data flow <DF_Benchmark_single_thread> is completed successfully.
(12.2) 10-03-12 21:12:57 (26292:3486270128) DATAFLOW: Process to execute data flow <DF_Benchmark_single_thread> is completed.
(12.2) 10-03-12 21:12:57 (23905:206135984)  PRINTFN: Time______________________________ 8 secounds
(12.2) 10-03-12 21:12:58 (26323:2865316528) DATAFLOW: Process to execute data flow <DF_Benchmark_lookup_DOP1> is started.
(12.2) 10-03-12 21:12:58 (26323:2865316528) DATAFLOW: Data flow <DF_Benchmark_lookup_DOP1> is started.
(12.2) 10-03-12 21:12:58 (26323:2865316528) DATAFLOW: Data flow <DF_Benchmark_lookup_DOP1> using IN MEMORY Cache.
(12.2) 10-03-12 21:13:15 (26323:2865316528) DATAFLOW: Data flow <DF_Benchmark_lookup_DOP1> is completed successfully.
(12.2) 10-03-12 21:13:16 (26323:2865316528) DATAFLOW: Process to execute data flow <DF_Benchmark_lookup_DOP1> is completed.
(12.2) 10-03-12 21:13:16 (23905:206135984)  PRINTFN: Time______________________________ 18 secounds
(12.2) 10-03-12 21:13:16 (26568:3538375344) DATAFLOW: Process to execute data flow <DF_Benchmark_lookup_DOP10> is started.
(12.2) 10-03-12 21:13:17 (26568:3538375344) DATAFLOW: Data flow <DF_Benchmark_lookup_DOP10> is started.
(12.2) 10-03-12 21:13:17 (26568:3538375344) DATAFLOW: Data flow <DF_Benchmark_lookup_DOP10> using IN MEMORY Cache.
(12.2) 10-03-12 21:13:37 (26568:3538375344) DATAFLOW: Data flow <DF_Benchmark_lookup_DOP10> is completed successfully.
(12.2) 10-03-12 21:13:37 (26568:3538375344) DATAFLOW: Process to execute data flow <DF_Benchmark_lookup_DOP10> is completed.
(12.2) 10-03-12 21:13:37 (23905:206135984)  PRINTFN: Time______________________________ 21 secounds
(12.2) 10-03-12 21:13:37 (23905:206135984)      JOB: Job <Job_Benchmark> is completed successfully.
Back to top
Werner Daehn
Forum Devotee
Forum Devotee



Joined: 17 Dec 2004

speaker.gif*6
Posts: 10591
Location: Germany


flag
PostPosted: Tue Oct 16, 2012 12:10 pm 
Post subject: Re: Benchmark YOUR hardware and compare the results V1.1

thanks - updated the table in the wiki.
_________________
Werner Daehn
Product Manager Data Services
SAP AG
�The opinions expressed in this post are my own views and not those of SAP.�
Back to top
s.tadili
Senior Member
Senior Member



Joined: 08 Nov 2011

Posts: 51



PostPosted: Tue Dec 04, 2012 8:57 am 
Post subject: Re: Benchmark YOUR hardware and compare the results V1.1

Name of the Test: Tadili
Source: Oracle 11g
Source Server Red Hat Ent Linux 5.8 64bit /2 CPU Xeon E5520 @2,27 GHz 4GB
Network source to DI: 100MBit Ethernet
DI server: Red Hat Ent Linux 5.8 64bit /2 CPU Xeon E5620 @2,40 GHz 8GB
DI: 12.2.3.4
Target: Oracle 11g
Target Server : Same as source


Quote:
13942 878472128 DATAFLOW 12/4/2012 1:47:03 PM Process to execute data flow <DF_Benchmark_read> is started.
13942 878472128 JOB 12/4/2012 1:47:04 PM Initializing transcoder for datastore <source_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
13942 878472128 JOB 12/4/2012 1:47:04 PM <<DEFAULT>>
13942 878472128 JOB 12/4/2012 1:47:04 PM Initializing transcoder for datastore <target_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
13942 878472128 JOB 12/4/2012 1:47:04 PM <<DEFAULT>>
13942 878472128 DATAFLOW 12/4/2012 1:47:04 PM Data flow <DF_Benchmark_read> is started.
13942 878472128 DATAFLOW 12/4/2012 1:47:04 PM Data flow <DF_Benchmark_read> using IN MEMORY Cache.
13942 878472128 DATAFLOW 12/4/2012 1:47:35 PM Data flow <DF_Benchmark_read> is completed successfully.
13942 878472128 DATAFLOW 12/4/2012 1:47:35 PM Process to execute data flow <DF_Benchmark_read> is completed.
13925 2974931904 PRINTFN 12/4/2012 1:47:35 PM Time______________________________ 31 secounds
14026 1698618304 DATAFLOW 12/4/2012 1:47:35 PM Process to execute data flow <DF_Benchmark_API_bulkloader> is started.
14026 1698618304 JOB 12/4/2012 1:47:36 PM Initializing transcoder for datastore <target_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
14026 1698618304 JOB 12/4/2012 1:47:36 PM <<DEFAULT>>
14026 1698618304 DATAFLOW 12/4/2012 1:47:36 PM Data flow <DF_Benchmark_API_bulkloader> is started.
14026 1698618304 DATAFLOW 12/4/2012 1:47:36 PM Data flow <DF_Benchmark_API_bulkloader> using IN MEMORY Cache.
14026 1078520128 BLKLDAPI 12/4/2012 1:47:36 PM Starting Bulk Loader API in <Dataflow DF_Benchmark_API_bulkloader; 4096>.
14026 1078520128 BLKLDAPI 12/4/2012 1:50:00 PM Bulk Loader API in <Dataflow DF_Benchmark_API_bulkloader> completed successfully.
14026 1698618304 DATAFLOW 12/4/2012 1:50:00 PM Data flow <DF_Benchmark_API_bulkloader> is completed successfully.
14026 1698618304 DATAFLOW 12/4/2012 1:50:00 PM Process to execute data flow <DF_Benchmark_API_bulkloader> is completed.
13925 2974931904 PRINTFN 12/4/2012 1:50:01 PM Time______________________________ 145 secounds
13925 2974931904 PRINTFN 12/4/2012 1:50:01 PM truncating target table via sql() function ...
13925 2974931904 PRINTFN 12/4/2012 1:50:01 PM truncating target table via sql() function ...done
14179 2304764864 DATAFLOW 12/4/2012 1:50:01 PM Process to execute data flow <DF_Benchmark_regular_load> is started.
14179 2304764864 JOB 12/4/2012 1:50:02 PM Initializing transcoder for datastore <target_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
14179 2304764864 JOB 12/4/2012 1:50:02 PM <<DEFAULT>>
14179 2304764864 DATAFLOW 12/4/2012 1:50:02 PM Data flow <DF_Benchmark_regular_load> is started.
14179 2304764864 DATAFLOW 12/4/2012 1:50:02 PM Data flow <DF_Benchmark_regular_load> using IN MEMORY Cache.
14179 2304764864 DATAFLOW 12/4/2012 1:52:21 PM Data flow <DF_Benchmark_regular_load> is completed successfully.
14179 2304764864 DATAFLOW 12/4/2012 1:52:21 PM Process to execute data flow <DF_Benchmark_regular_load> is completed.
13925 2974931904 PRINTFN 12/4/2012 1:52:21 PM Time______________________________ 140 secounds
13925 2974931904 PRINTFN 12/4/2012 1:52:21 PM truncating target table via sql() function ...
13925 2974931904 PRINTFN 12/4/2012 1:52:23 PM truncating target table via sql() function ...done
14342 2522942400 DATAFLOW 12/4/2012 1:52:23 PM Process to execute data flow <DF_Benchmark_single_thread> is started.
14342 2522942400 JOB 12/4/2012 1:52:23 PM Initializing transcoder for datastore <target_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
14342 2522942400 JOB 12/4/2012 1:52:23 PM <<DEFAULT>>
14342 2522942400 DATAFLOW 12/4/2012 1:52:23 PM Data flow <DF_Benchmark_single_thread> is started.
14342 2522942400 DATAFLOW 12/4/2012 1:52:23 PM Data flow <DF_Benchmark_single_thread> using IN MEMORY Cache.
14342 2522942400 DATAFLOW 12/4/2012 1:52:32 PM Data flow <DF_Benchmark_single_thread> is completed successfully.
14342 2522942400 DATAFLOW 12/4/2012 1:52:32 PM Process to execute data flow <DF_Benchmark_single_thread> is completed.
13925 2974931904 PRINTFN 12/4/2012 1:52:32 PM Time______________________________ 9 secounds
14369 4084890560 DATAFLOW 12/4/2012 1:52:32 PM Process to execute data flow <DF_Benchmark_lookup_DOP1> is started.
14369 4084890560 JOB 12/4/2012 1:52:33 PM Initializing transcoder for datastore <target_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
14369 4084890560 JOB 12/4/2012 1:52:33 PM <<DEFAULT>>
14369 4084890560 JOB 12/4/2012 1:52:33 PM Initializing transcoder for datastore <source_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
14369 4084890560 JOB 12/4/2012 1:52:33 PM <<DEFAULT>>
14369 4084890560 DATAFLOW 12/4/2012 1:52:33 PM Data flow <DF_Benchmark_lookup_DOP1> is started.
14369 4084890560 DATAFLOW 12/4/2012 1:52:33 PM Data flow <DF_Benchmark_lookup_DOP1> using IN MEMORY Cache.
14369 4084890560 DATAFLOW 12/4/2012 1:52:53 PM Data flow <DF_Benchmark_lookup_DOP1> is completed successfully.
14369 4084890560 DATAFLOW 12/4/2012 1:52:53 PM Process to execute data flow <DF_Benchmark_lookup_DOP1> is completed.
13925 2974931904 PRINTFN 12/4/2012 1:52:53 PM Time______________________________ 20 secounds
14421 1748556736 DATAFLOW 12/4/2012 1:52:53 PM Process to execute data flow <DF_Benchmark_lookup_DOP10> is started.
14421 1748556736 JOB 12/4/2012 1:52:53 PM Initializing transcoder for datastore <target_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
14421 1748556736 JOB 12/4/2012 1:52:53 PM <<DEFAULT>>
14421 1748556736 JOB 12/4/2012 1:52:53 PM Initializing transcoder for datastore <source_ds> to transcode between engine codepage<Unicode (UTF-16)> and datastore codepage
14421 1748556736 JOB 12/4/2012 1:52:53 PM <<DEFAULT>>
14421 1748556736 DATAFLOW 12/4/2012 1:52:54 PM Data flow <DF_Benchmark_lookup_DOP10> is started.
14421 1748556736 DATAFLOW 12/4/2012 1:52:54 PM Data flow <DF_Benchmark_lookup_DOP10> using IN MEMORY Cache.
14421 1748556736 DATAFLOW 12/4/2012 1:53:10 PM Data flow <DF_Benchmark_lookup_DOP10> is completed successfully.
14421 1748556736 DATAFLOW 12/4/2012 1:53:11 PM Process to execute data flow <DF_Benchmark_lookup_DOP10> is completed.
13925 2974931904 PRINTFN 12/4/2012 1:53:11 PM Time______________________________ 17 secounds
13925 2974931904 JOB 12/4/2012 1:53:11 PM Job <Job_Benchmark> is completed successfully.
Back to top
H. Westerhof
Senior Member
Senior Member



Joined: 26 Mar 2010

Posts: 65
Location: Groningen


flag
PostPosted: Mon Apr 14, 2014 7:45 am 
Post subject: Re: Benchmark YOUR hardware and compare the results V1.1

Name of the Test: Sybase IQ BODS Proof of Concept
Source: Sybase IQ 16.0 SP3
Source Server: Windows Server 2008 R2 64bit / 2x Xeon E5-2690 @ 2.94 Ghz (32 cores), 256 GB RAM
Network source to DI: N/A, IQ and BODS on same server
DI server: same as source server
DI: BODS 4.2 SP1 Patchlevel 3 (14.2.1.622)
Target: same as source server
Target Server : same as source server


21044 26900 DATAFLOW 4/14/2014 2:29:48 PM Process to execute data flow <DF_Benchmark_read> is completed.
23256 25360 PRINTFN 4/14/2014 2:29:49 PM Time______________________________ 83 secounds

27356 21864 DATAFLOW 4/14/2014 2:31:26 PM Process to execute data flow <DF_Benchmark_API_bulkloader> is completed.
23256 25360 PRINTFN 4/14/2014 2:31:26 PM Time______________________________ 97 secounds

15276 27176 DATAFLOW 4/14/2014 2:36:20 PM Process to execute data flow <DF_Benchmark_regular_load> is completed.
23256 25360 PRINTFN 4/14/2014 2:36:20 PM Time______________________________ 294 secounds

15384 26784 DATAFLOW 4/14/2014 2:36:34 PM Process to execute data flow <DF_Benchmark_single_thread> is completed.
23256 25360 PRINTFN 4/14/2014 2:36:34 PM Time______________________________ 13 secounds

23492 26780 DATAFLOW 4/14/2014 2:36:43 PM Process to execute data flow <DF_Benchmark_lookup_DOP1> is completed.
23256 25360 PRINTFN 4/14/2014 2:36:43 PM Time______________________________ 8 secounds

27824 12752 DATAFLOW 4/14/2014 2:36:49 PM Process to execute data flow <DF_Benchmark_lookup_DOP10> is completed.
23256 25360 PRINTFN 4/14/2014 2:36:50 PM Time______________________________ 6 secounds

Quite some great results I think icon_smile.gif
Back to top
Display posts from previous:   
Register or Login to Post    Forum Index -> Data Integrator -> DI: Performance and Tuning  Previous TopicPrint TopicNext Topic
Page 10 of 10 All times are GMT - 5 Hours
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10
 
Jump to:  

Index | About | FAQ | RAG | Privacy | Search |  Register |  Login 

Get community updates via Twitter:

Not endorsed by or affiliated with SAP
Powered by phpBB © phpBB Group
Generated in 0.0317 seconds using 17 queries. (SQL 0.0028 Parse 0.0009 Other 0.0280)
CCBot/2.0 (https://commoncrawl.org/faq/)
Hosted by ForumTopics.com | Terms of Service
phpBB Customizations by the phpBBDoctor.com
Shameless plug for MomentsOfLight.com Moments of Light Logo