Matlab benchmark

My own Matlab benchmark suite jmbench.m because timings from Matlab "bench" command cannot be used to compare Matlab versions

The tables contain time in seconds, smaller is better. Only comparisons within the same column are meaningful. The comparisons may not be 100% fair to the machines because there are no special versions of Matlab compiled for specific flavors of the CPUs, but they do show what you get when running the application. The script runs each benchmark thrice and I record in the table the best time for each category. If you send me the output of jmbench.m on other machines I'll be happy to include it here.

The benchmark compares the following:

Large LU: mostly floating point speed (starting R12, memory bound before)
Small LU: floating + integer speed on in-cache data
Sparse: cpu + random memory access, largely memory bound

Matlab R2008a
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
Intel Core 2 Duo	2.5GHz	Macbook Pro 15" OS X Leopard	0.191	0.812	0.229

Matlab R2007b
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
Intel Core 2 X9650 (4 cores) /Fedora 7	3GHz	ASUS P5K3 Deluxe WiFi 8GB DDR3 1333MHz 7-7-7-20	0.136	0.375	0.123
#2x dual core AMD Opteron 2200 /Win XP	2.8GHz	HP xw9400 hyperthreading off	0.374	0.660	0.166
#Intel Core2 Duo T7300 /Win XP	2GHz	HP 6910P (Laptop)	0.304	0.695	0.172
*AMD Turion 64 X2 TL-66/Fedora 8 x64, Matlab 32bit	2.3GHz	HP Pavilion tx1420us Tablet PC 3GB	0.403	0.840	0.232
*AMD Turion 64 X2 TL-66/Vista Home Premium	2.3GHz	HP Pavilion tx1420us Tablet PC 3GB	0.540	0.870	0.227

# run by Mattias Villani
* run by Bedrich Sousedik

Matlab R2007a
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
2xIntel Xeon E5310 (4 cores)/Fedora 6	1.6GHz	Western Scientific Velocity 16GB/wf	0.278	0.776	0.202
*Core 2 Duo/Mac OS 10.5.1	2.4GHz	MacBookPro3,1	0.309	1.135	0.309

* run by James Sumners

Matlab R14 a.k.a 7
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
2x Dual Core Opteron 275/Fedora Core 3 AMD64	2.2GHz	IWILL DK8AEW 16GB DDR-400/opt4	0.417	0.747	0.299
Dual Opteron 248/Fedora Core 1 AMD64	2.2GHz	Tyan K8W S2885 4GB PC2700/pogo01	0.576	1.303	0.330
Athlon 64 3400+/Fedora Core2 64bit	2.2GHz	MSI K8T Neo-FIS2R K8T800 2x1GB DDR400 Pogo Linux Altura64 / pogocat	0.588	1.315	0.330
Pentium 4/Linux RH 7.3/333MHz DDR	3.06GHz	Asus P4G8X dlx mobo 533FSB / Godzilla	0.612	1.099	0.444
#GB Dual Pentium 4 Xeon HT/Linux RH 9.0	3.06GHz	Dell PowerEdge 1750	0.619	1.136	0.439
Pentium 4/Win XP Home	2.8GHz	Toshiba A45-S250 512MB / Beda's laptop	0.703	1.312	0.375
UltraSPARC-III+/Solaris 9	1.2GHz	Sun Fire 880/mathsun	0.800	2.478	0.575
*JS Pentium M/WinXP Pro Optimized Intel MKL Library	1.6GHz	Dell Latitude D800	0.851	1.182	0.410
Dual Opteron 240/Win XP SP1a	1.4GHz	Tyan S2885 mobo PC2700DDR 128bit mode	0.844	2.625	0.453
*JK Athlon XP 2200+/Win XP ProSP1	2200+	Asus A7V333 mobo DDR 333MHz	0.922	2.203	0.469
*JS Pentium M/WinXP Pro	1.6GHz	Dell Latitude D800	1.032	1.802	0.420
Pentium M 745/WinXP Pro	1.8GHz	Dell Inspiron 600m / Jan's laptop	1.042	1.572	0.351
Pentium 3M/WinXP Pro	877MHz	Dell Latitude C400 / Jan's laptop	3.304	6.079	1.642

*JK = run by Jan Karlsson, Sweden
*JS = run by Janne simonen, Japan

Matlab R14 AMD/Intel 64 bit beta
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
Athlon 64 3400+/Fedora Core2 64bit	2.2GHz	MSI K8T Neo-FIS2R K8T800 2x1GB DDR400 Pogo Linux Altura64 / pogocat	0.438	0.715	0.290
#HD Dual Opteron 246/Suse 9.0 64bit	2.0GHz	Tyan K8S 4GB 333MHz DDR	0.508	0.802	0.292

#HD = run by Huseyin Demir, Georgia Tech Savannah

Matlab R13 a.k.a 6.5
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
#GB$M Power 4 /AIX 5.1	1.3GHz	IBM p690 LPAR 32GB	0.467	1.576	0.907
#CC Pentium 4 HT disabled/WinXP Pro	3.2GHz	Siemens SCENIC W 1.5GB DDR2-4200 no ECC CL 4-4-4	0.591	1.109	0.314
$$dual Opteron 248/Linux RHELAS 3	2.2GHz	Sun V20z 8GB pc2700	0.597	1.329	0.969
Pentium 4/Linux RH 7.3/333MHz DDR	3.06GHz	Asus P4G8X dlx mobo 533FSB / Godzilla	0.627	1.152	1.275
#HD Dual Opteron 246/Suse 9.0 64bit	2.0GHz	Tyan K8S 4GB 333MHz DDR	0.644	1.573	0.955
**Dual Opteron 246/Fedora Core 1 AMD64	2GHz	Tyan K8W S2885 4GB PC2100	0.669	1.454	0.985
#HD Dual Opteron 246/WinXP	2.0GHz	Tyan K8S 4GB 333MHz DDR	0.703	1.640	0.734
$$dual Opteron 244/Linux RHELAS 3	1.8GHz	Sun V20z 4GB pc3200	0.716	1.622	1.029
#$Xeon/p4/Linux RH 7.3	2.4HGz	Supermicro x5dae 533MHz FSB	0.757	1.571	1.424
Pentium 4/Linux RH 7.3/PC800RDRAM	2.2GHz	Western Scientific / Skylla	0.803	1.875	1.579
#*Pentium 4-B/Win XP PRO SP1	3.06GHz	ASUS P4B533 533MHz FSB mobo PC2700 2*512MB	0.828	2.219	1.954
*Alpha 21364/EV7 OSF5.1	1.15GHz	Compaq ES40	0.874	2.520	0.748
#Athlon XP/Win2k SP2	2400+	EPOX 8KHA+ mobo 266FSB	0.922	2.103	1.762
##Athlon XP1800+/Win2k SP2	1575	ASUS A7N7X dlx 274FSB PC2100	0.953	2.578	1.562
Pentium M 745/WinXP Pro	1.8GHz	Dell Inspiron 600m / Jan's laptop	0.982	1.582	1.382
Dual Opteron 240/Win XP SP1a	1.4GHz	Tyan S2885 mobo PC2700DDR 128bit mode	1.016	2.250	1.250
Dual Opteron 240/Win XP SP1a	1.4GHz	Tyan S2885 mobo PC2700DDR 64bit mode	1.016	2.250	1.328
Celeron/WinXP	2.4GHz	Dell Inspiron 1100 / Alan's laptop	1.031	2.613	1.863
Pentium 4/Linux RH 7.3/PC800RDRAM	1.7GHz	Western Scientific / p4	1.044	2.474	1.816
*PA8500/hpux11.11	440	HPJ5000	1.194	5.638	2.608
*athlonXP/RH7.2	1800+	na	1.343	2.881	2.665
Pentium M/WinXP	1.2GHz	Dell Latitude X300 / Leo's laptop	1.412	2.383	1.733
*athlon/mdk8.0	1000	na	1.590	3.260	3.070
Pentium M / Win XP	1GHz	Panasonic Toughbook CF-W2/dept loaner	1.602	3.255	1.822
*ES40/EV6 OSF5.1	600	Compaq ES40	2.089	6.031	2.201
Pentium 3M/WinXP	1GHz	Dell Latitude C400 / Jan's laptop	2.203	3.375	4.096
Pentium 3/RH 7.3	933MHz	Tyan S2567 mobo/beowulf master	2.205	4.772	3.312
Alpha DS20/OSF 5	500MHz	Vader	2.053	6.006	1.829
+Power PC G4/OS X 10.2.2	800	Apple TiBook	2.292	6.542	3.994
+$ Power PC G4/OS 10.3.3	867MHz	Apple Powerbook 12"	3.184	8.535	3.747
Pentium 3/Win2k SP1	700MHz	Dell Latitude L400	3.974	5.999	6.269
+$ Power PC G3/OS 10.3.3	800MHz	Apple iBook	4.226	8.990	6.460
*R10000/irix64	195	SGI octane	5.976	16.360	8.062
*PII/mdk7.2	266	galerkin	8.188	17.344	10.590

#CC = run by Carlos Climent
+$ = run by Wee Jin Goh, Oxford Brookes
#$ = run by Jonas August, CMU
$$ = run by Zach Johnson, UC Davis
#* = run by Matt Kelly, U Arkansas
** = run by Alexander Berg, Berkeley
## = run by Lars Ulveland, memory timings 2.5-3-3-7, spread spectrum disabled
#GB = run by Gregory Bauer, UIUC
$M = multi-user machine with sustained load of 8 on 16
* = run by Olivier Dessombz, Ecole Centrale de Lyon
+ = run by Ian Goh, John Hopkins University
# = run by Andrew Diamond; 2400+ is "speed unoficially meant to give about the same performance as 2.4GHz P4"

Matlab R13 pre-release
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
Pentium 4/Linux RH7.2	1.5GHz	Dell Precision 330	1.161	2.760	2.013

Matlab R12.1
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
#Athlon XP/Win2k SP2	2400+	EPOX 8KHA+ mobo 266FSB	0.821	2.183	1.652
Pentium 4/PC800Rambus/RH72	2.2GHz	Western Scientific/Skylla	0.912	1.738	1.500
#CC Asus M6Ne PentiumM/Windows XP Home SP2	1.6GHz	512MB	1.001	1.763	1.282
*Pentium 4/?	2GHz	HP X2000	1.071	2.390	1.603
Pentium 3/Win 2k	700	Dell Latitude L400	3.845	8.112	6.840
*HP C3700	750	na	1.445	3.627	2.014
*Sun Blade 100	500	na	29.652	20.924	6.960
*HP B2600	500	na	2.099	5.439	2.419
*Sun Fire V880	750	na	1.683	4.270	1.996
Pentium 3/RedHat 7.1	1 GHz	Dell Poweredge 2400/math	1.955	4.482	3.568
Pentium 3/RedHat 7.0	933	Supermicro 370DER mobo/beowulf	2.007	4.558	3.269
Pentium 3/RedHat 7.0	933	Tyan S2567 mobo/beowulf master	1.974	4.591	3.352
Pentium 4/Win2000	1.4GHz	Compaq	1.299	3.365	1.832
Pentium 4/Win2000 SP1	1.5GHz	Dell Precision 330	1.642	3.585	1.753
Pentium 4/Redhat 7.1	1.5GHz	Dell Precision 330	1.299	2.906	1.782
Pentium 4/Redhat 7.1	1.7GHz	Western Scientific - p4	1.174	2.659	1.725

* = run by Tomas Lovato

Matlab R12
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
Pentium 4/SUSE Linux 7.3	1.6GHz	SONY VAIO PCG-GRX150/wall power	1.297	2.523	2.637
Pentium 4/SUSE Linux 7.3	1.6GHz	SONY VAIO PCG-GRX150/battery	1.699	3.495	2.996
*Pentium 3/Win XP Pro	1.2GHz	Dell Latitude 610	1.763	2.964	3.225
Pentium 4/Win2000 SP1	1.5GHz	Dell Precision 330	1.402	3.885	1.732
Pentium 4/Redhat 7.1	1.5GHz	Dell Precision 330	1.302	2.904	1.781
Alpha EV6/Unix 4.0f	500	AlphaServer DS20 - vader	1.980	6.611	2.307
Pentium III/Win2k	700	Toshiba Tecra 8100 - lapcat	7.691	20.169	11.096
Pentium III/RH6.2 vmware on win2k	700	Toshiba Tecra 8100 - lapcat	8.999	20.617	17.994
SUN UltraSparc IIi/Solaris 7	440	SUN AXi - puzin	2.506	7.525	5.052
Pentium III/RedHat6.2	500	linus	3.613	8.566	5.059
Pentium Pro/NT4Sp6	500	no name	3.938	9.437	5.547

* = run by Alexander Karapetyan
# = run by Andrew Diamond

Matlab R11
 

CPU/OS	MHz	Name	Large LU	Small LU	Sparse
Alpha EV6/Unix 4.0f	500	AlphaServer DS20 - vader	6.316	7.532	2.775
Pentium III/Win2K	700	Toshiba Tecra 8100 - lapcat	9.604	8.552	8.042
SUN UltraSparc IIi/Solaris 7	440	SUN AXi - puzin	23.187	18.107	6.591
Pentium III/RedHat6.2	500	linus	28.201	14.307	9.664

LU measures primarily floating point speed
Sparse has a strong integer component
From the Matlab command "bench", smaller  is better