[lnkForumImage]
TotalShareware - Download Free Software
Confronta i prezzi di migliaia di prodotti.
Asp Forum
 Home | Login | Register | Search 


 

Forums >

comp.lang.ruby

Minor 1.8 <-> 1.9 performance comparison gotcha

Gregory Brown

2/2/2009 1:29:00 AM

Excited and inspired by the Ruby 1.9.1 release, I wrote a blog post
the other day talking about how much faster Prawn's examples and tests
run on Ruby 1.9 out of the box. Of course, this isn't scientific
benchmarking but it seemed like a reasonable way to say "Across the
board, things run much faster".

As it turns out, there was a fatal flaw in my (admittedly
unscientific) analysis. It turned out that my Ruby 1.8.6 was built
without any compile time optimization, but my Ruby 1.9 build had been
set to -O2 . The difference was HUGE and completely skewed my
results.

This is almost certainly a silly mistake that most people who have
experience comparing manually compiled software would not make, but
I'm sure it'll trip up some folks who don't know what to look for. So
the lesson I learned was: If you're doing performance comparisons,
either to share with the community or for your own needs, be sure to
check your CFLAGS.

$ ruby -e "require 'rbconfig'; puts Config::CONFIG['CFLAGS']"
$ ruby19 -e "require 'rbconfig'; puts Config::CONFIG['CFLAGS']"

If the optimization levels don't match, all bets are off :)

You can see the before[0] and after[1] if you wish, otherwise, sorry
to spam those in the know.
Hopefully this quick warning will be helpful to those who might not
have considered it otherwise.

-greg

PS: Jamis Buck helped me track this issue down, so if he's reading: Thanks!

[0] http://blog.majesticseacreature.com/archives/2009.01/prawn_and_r...
[1] http://blog.majesticseacreature.com/archives/2009.02/lies_and_stati...
15 Answers

M. Edward (Ed) Borasky

2/2/2009 1:47:00 AM

0

On Sun, Feb 1, 2009 at 5:29 PM, Gregory Brown <gregory.t.brown@gmail.com> wrote:
> Excited and inspired by the Ruby 1.9.1 release, I wrote a blog post
> the other day talking about how much faster Prawn's examples and tests
> run on Ruby 1.9 out of the box. Of course, this isn't scientific
> benchmarking but it seemed like a reasonable way to say "Across the
> board, things run much faster".
>
> As it turns out, there was a fatal flaw in my (admittedly
> unscientific) analysis. It turned out that my Ruby 1.8.6 was built
> without any compile time optimization, but my Ruby 1.9 build had been
> set to -O2 . The difference was HUGE and completely skewed my
> results.
>
> This is almost certainly a silly mistake that most people who have
> experience comparing manually compiled software would not make, but
> I'm sure it'll trip up some folks who don't know what to look for. So
> the lesson I learned was: If you're doing performance comparisons,
> either to share with the community or for your own needs, be sure to
> check your CFLAGS.
>
> $ ruby -e "require 'rbconfig'; puts Config::CONFIG['CFLAGS']"
> $ ruby19 -e "require 'rbconfig'; puts Config::CONFIG['CFLAGS']"
>
> If the optimization levels don't match, all bets are off :)
>
> You can see the before[0] and after[1] if you wish, otherwise, sorry
> to spam those in the know.
> Hopefully this quick warning will be helpful to those who might not
> have considered it otherwise.
>
> -greg
>
> PS: Jamis Buck helped me track this issue down, so if he's reading: Thanks!
>
> [0] http://blog.majesticseacreature.com/archives/2009.01/prawn_and_r...
> [1] http://blog.majesticseacreature.com/archives/2009.02/lies_and_stati...
>
>

It's been a while since I recompiled either of them, but as long as
you're going to recompile:

1. As far as I know, '-O3' is safe for both 1.8.x and 1.9.x. I haven't
measured the performance improvement recently, but someone did a while
back and it was at least measurable.

2. You should also take advantage of the GCC '-march=' and '-mtune='
options and specify exactly what kind of processor(s) you have. You
may have to do a Google search of the GCC documentation on their web
site to find the exact list of processor types, but it is usually
worth it. Note that most Linux distros, with the happy exception of
openSUSE, provide binaries compiled with only i386 processor features
on 32-bit x86 machines. openSUSE compiles with i586 on 32-bit x86
machines. I'm not even sure you can get enough RAM in an i386 to even
run the 2.6 kernel, let alone a desktop or a Ruby interpreter. :)

--
M. Edward (Ed) Borasky

I've never met a happy clam. In fact, most of them were pretty steamed.

Joel VanderWerf

2/2/2009 1:55:00 AM

0

M. Edward (Ed) Borasky wrote:
> 2. You should also take advantage of the GCC '-march=' and '-mtune='
> options and specify exactly what kind of processor(s) you have.

http://gcc.gnu.org/gcc-4.2/ch... says:
> -mtune=native and -march=native will produce code optimized for the
> host architecture as detected using the cpuid instruction.

Has anyone tried this with ruby?

--
vjoel : Joel VanderWerf : path berkeley edu : 510 665 3407

M. Edward (Ed) Borasky

2/2/2009 2:19:00 AM

0

On Sun, Feb 1, 2009 at 5:55 PM, Joel VanderWerf <vjoel@path.berkeley.edu> wrote:
> M. Edward (Ed) Borasky wrote:
>>
>> 2. You should also take advantage of the GCC '-march=' and '-mtune='
>> options and specify exactly what kind of processor(s) you have.
>
> http://gcc.gnu.org/gcc-4.2/ch... says:
>>
>> -mtune=native and -march=native will produce code optimized for the
>> host architecture as detected using the cpuid instruction.
>
> Has anyone tried this with ruby?

I have done it, but not recently. It's pretty easy to do. For example,
on my Linux Athlon64 X2:

cd <ruby-source>
export CFLAGS='-O3 -march=athlon64 -mtune=athlon64'
/configure
make
make test # be sure the compiler didn't break something!!!
make benchmark # 1.9.x only!
sudo make install




--
M. Edward (Ed) Borasky

I've never met a happy clam. In fact, most of them were pretty steamed.

Joel VanderWerf

2/2/2009 2:43:00 AM

0

M. Edward (Ed) Borasky wrote:
> On Sun, Feb 1, 2009 at 5:55 PM, Joel VanderWerf <vjoel@path.berkeley.edu> wrote:
>> M. Edward (Ed) Borasky wrote:
>>> 2. You should also take advantage of the GCC '-march=' and '-mtune='
>>> options and specify exactly what kind of processor(s) you have.
>> http://gcc.gnu.org/gcc-4.2/ch... says:
>>> -mtune=native and -march=native will produce code optimized for the
>>> host architecture as detected using the cpuid instruction.
>> Has anyone tried this with ruby?
>
> I have done it, but not recently. It's pretty easy to do. For example,
> on my Linux Athlon64 X2:
>
> cd <ruby-source>
> export CFLAGS='-O3 -march=athlon64 -mtune=athlon64'
> ./configure
> make
> make test # be sure the compiler didn't break something!!!
> make benchmark # 1.9.x only!
> sudo make install

What about

CFLAGS='-O3 -march=native -mtune=native'

I was assuming that's how the new feature in gcc 4.2 works (only got 4.1
here at the moment).

--
vjoel : Joel VanderWerf : path berkeley edu : 510 665 3407

M. Edward (Ed) Borasky

2/2/2009 5:18:00 AM

0

Joel VanderWerf wrote:
> M. Edward (Ed) Borasky wrote:
>> On Sun, Feb 1, 2009 at 5:55 PM, Joel VanderWerf
>> <vjoel@path.berkeley.edu> wrote:
>>> M. Edward (Ed) Borasky wrote:
>>>> 2. You should also take advantage of the GCC '-march=' and '-mtune='
>>>> options and specify exactly what kind of processor(s) you have.
>>> http://gcc.gnu.org/gcc-4.2/ch... says:
>>>> -mtune=native and -march=native will produce code optimized for the
>>>> host architecture as detected using the cpuid instruction.
>>> Has anyone tried this with ruby?
>>
>> I have done it, but not recently. It's pretty easy to do. For example,
>> on my Linux Athlon64 X2:
>>
>> cd <ruby-source>
>> export CFLAGS='-O3 -march=athlon64 -mtune=athlon64'
>> ./configure
>> make
>> make test # be sure the compiler didn't break something!!!
>> make benchmark # 1.9.x only!
>> sudo make install
>
> What about
>
> CFLAGS='-O3 -march=native -mtune=native'
>
> I was assuming that's how the new feature in gcc 4.2 works (only got
> 4.1 here at the moment).
>
That should work. Actually, I need to read the manual -- you don't need
both "-march" and "-mtune" IIRC, and one of them is "deprecated".

> gcc --version
gcc (SUSE Linux) 4.3.2 [gcc-4_3-branch revision 141291]


--
M. Edward (Ed) Borasky

I've never met a happy clam. In fact, most of them were pretty steamed.

M. Edward (Ed) Borasky

2/2/2009 5:33:00 AM

0

M. Edward (Ed) Borasky wrote:
>> gcc --version
>>
> gcc (SUSE Linux) 4.3.2 [gcc-4_3-branch revision 141291]
>
>
>
OK ... here's the manual page for x86 and x86_64:

http://gcc.gnu.org/onlinedocs/gcc-4.3.3/gcc/i386-and-x86_002d64-Options.html#i386-and-x86_002d...

Essentially, if you're compiling and always running on the same system,
the magic code is "-march=native". For older versions of GCC that don't
have "native", use "-march=<whatever>".

The difference between "-march" and "-mtune" is documented there as
well. Basically, "-march" code is guaranteed to run only on the specific
architecture variant called out in the flag.

--
M. Edward (Ed) Borasky

I've never met a happy clam. In fact, most of them were pretty steamed.

Ollivier Robert

2/3/2009 9:47:00 AM

0

In article <af0420cd0902011747x4b1ed970rf7aff546dab1d6b6@mail.gmail.com>,
M. Edward (Ed) Borasky <znmeb@cesmail.net> wrote:
>2. You should also take advantage of the GCC '-march=' and '-mtune='
>options and specify exactly what kind of processor(s) you have. You
>may have to do a Google search of the GCC documentation on their web

Last time I tried trunk of 1.9 with llvm-gcc-4.2/4.3, it didn't work.

I'll try again.
--
Ollivier ROBERT -=- CND/COE/VI/SQ -=- EUROCONTROL
Systems Quality & Support

Radoslaw Bulat

2/3/2009 12:54:00 PM

0

On Mon, Feb 2, 2009 at 3:18 AM, M. Edward (Ed) Borasky
<znmeb@cesmail.net> wrote:
> cd <ruby-source>
> export CFLAGS=3D'-O3 -march=3Dathlon64 -mtune=3Dathlon64'
> ./configure
> make

I do:
export CFLAGS=3D"-O3 -march=3Dnative -mtune=3Dnative"
/configure
make

and see

gcc -O3 -march=3Dnative -mtune=3Dnative -O2 -g -Wall -Wno-parentheses (...)

It is ok if my options goes before default options to gcc? I wonder
what gcc will take, O2 or O3?


--=20
Pozdrawiam

Rados=B3aw Bu=B3at
http://radarek... - m=F3j blog

M. Edward (Ed) Borasky

2/4/2009 4:57:00 PM

0

Rados3aw Bu3at wrote:
> On Mon, Feb 2, 2009 at 3:18 AM, M. Edward (Ed) Borasky
> <znmeb@cesmail.net> wrote:
>> cd <ruby-source>
>> export CFLAGS='-O3 -march=athlon64 -mtune=athlon64'
>> ./configure
>> make
>
> I do:
> export CFLAGS="-O3 -march=native -mtune=native"
> ./configure
> make
>
> and see
>
> gcc -O3 -march=native -mtune=native -O2 -g -Wall -Wno-parentheses (...)
>
> It is ok if my options goes before default options to gcc? I wonder
> what gcc will take, O2 or O3?
>
>

Well ... gcc will take the *last* option it sees, so it will use -O2 :(.
There is a work-around, though. After you unpack the 1.9.1 tarball,
there will be a file in the main directory called "configure.in". Around
line 193 you'll see a definition for "optflags":

if test "$GCC" = yes; then
linker_flag=-Wl,
: ${optflags=-O2} ${warnflags="-Wall -Wno-parentheses"}
else
linker_flag=
fi

Change the "-O2" to "-O3". Then do

autoconf
export CFLAGS="-march=native"
/configure
make

Then the compile lines should look like this

gcc -march=native -O3 -g -Wall -Wno-parentheses (...)

Make sure you look at the output from "make test" to verify that the
extra level of optimization didn't cause bugs. In fact, you should
probably run "RubySpec" against the resulting Ruby interpreter as well. :)

--
M. Edward (Ed) Borasky

I've never met a happy clam. In fact, most of them were pretty steamed.

Space-Bo

1/30/2011 2:53:00 AM

0

>
> Always nice to have a big truck available. :)
>
Yup! Right up to the point when a hydraulic hose blew on the lift and
dumped a couple of gallons of hydraulic fluid on the side walk! The
good new is we had most of the heavy lifting done by that time.

DD