[lnkForumImage]
TotalShareware - Download Free Software
Confronta i prezzi di migliaia di prodotti.
Asp Forum
 Home | Login | Register | Search 


 

Forums >

comp.lang.ruby

Does anyone have benchmark programs for YARV?

SASADA Koichi

12/2/2004 11:34:00 AM

Hi,

I'm developing YARV - Yet Another RubyVM. I'm looking for
benchmark programs to evaluate YARV's performance. So, Does
anyone have suitable benchmarks for this purpose?

Current YARV has some limitations (especially, can't require
any files). But I can fix YARV or your program to work and
measure execution time.

If you have a ruby program which is slow for you, feel free to
send me that :) Perhaps, YARV will be optimized for your
application.

Thanks,
--
// SASADA Koichi at atdot dot net
//
17 Answers

Florian Gross

12/2/2004 12:28:00 PM

0

SASADA Koichi wrote:

> I'm developing YARV - Yet Another RubyVM. I'm looking for
> benchmark programs to evaluate YARV's performance. So, Does
> anyone have suitable benchmarks for this purpose?

Maybe you can have a look at the Ruby code for the Debian language
shootout (available at http://shootout.alioth.d...) -- that way
you could also easily compare performance to that of other programming
languages which might be a good motivation.

SASADA Koichi

12/2/2004 1:10:00 PM

0

Hi,

I already use that:)
http://www.atdot.net/svn/yarv/trunk/...

Thanks anyway.

Florian Gross wrote:
> SASADA Koichi wrote:
>
>
>>I'm developing YARV - Yet Another RubyVM. I'm looking for
>>benchmark programs to evaluate YARV's performance. So, Does
>>anyone have suitable benchmarks for this purpose?
>
>
> Maybe you can have a look at the Ruby code for the Debian language
> shootout (available at http://shootout.alioth.d...) -- that way
> you could also easily compare performance to that of other programming
> languages which might be a good motivation.
>


Jamis Buck

12/2/2004 2:15:00 PM

0

SASADA Koichi wrote:
> Hi,
>
> I'm developing YARV - Yet Another RubyVM. I'm looking for
> benchmark programs to evaluate YARV's performance. So, Does
> anyone have suitable benchmarks for this purpose?
>
> Current YARV has some limitations (especially, can't require
> any files). But I can fix YARV or your program to work and
> measure execution time.
>
> If you have a ruby program which is slow for you, feel free to
> send me that :) Perhaps, YARV will be optimized for your
> application.
>
> Thanks,

I don't know if this is what you are looking for or not, but Needle
(http://rubyforge.org/proje...) has a 'benchmarks' subdirectory
with a handful of different benchmarks.

If you manage to get them to run under YARV, I'd love to see the results. :)

- Jamis

--
Jamis Buck
jgb3@email.byu.edu
http://www.jamisbuck...

Florian Gross

12/2/2004 2:21:00 PM

0

SASADA Koichi wrote:

> I already use that:)
> http://www.atdot.net/svn/yarv/trunk/...

Interesting, is the speedup in percent available somewhere?

gabriele renzi

12/3/2004 9:20:00 AM

0

SASADA Koichi ha scritto:
> Hi,
>
> I'm developing YARV - Yet Another RubyVM. I'm looking for
> benchmark programs to evaluate YARV's performance. So, Does
> anyone have suitable benchmarks for this purpose?

I don't have a benchmark.. but I think the OO Richards Benchmark as
found here:
http://pws.prserv.net/dlissett//ben/bench1-r...
may be interesting.

> Current YARV has some limitations (especially, can't require
> any files). But I can fix YARV or your program to work and
> measure execution time.
>
> If you have a ruby program which is slow for you, feel free to
> send me that :) Perhaps, YARV will be optimized for your
> application.

Not that it is a valuable application... but I have this dumb example of
using backtracking to solve the map coloring problem as found here:
http://www.ccs.neu.edu/home/dorai/t-y-scheme/t-y-scheme-Z-H-16.html#node_...

It stresses callcc a lot and takes ~15 seconds to terminate on my old
athlon 2000 box.
If you want take a look at it at:
http://rafb.net/paste/results/x4g...

(sorry for italian naming I guess it is still understandable :)

gabriele renzi

12/3/2004 4:00:00 PM

0

gabriele renzi ha scritto:
> SASADA Koichi ha scritto:
>
>>Hi,
>>
>>I'm developing YARV - Yet Another RubyVM. I'm looking for
>>benchmark programs to evaluate YARV's performance. So, Does
>>anyone have suitable benchmarks for this purpose?
>
>
> I don't have a benchmark.. but I think the OO Richards Benchmark as
> found here:
> http://pws.prserv.net/dlissett//ben/bench1-r...
> may be interesting.
>
>
>>Current YARV has some limitations (especially, can't require
>>any files). But I can fix YARV or your program to work and
>>measure execution time.
>>
>>If you have a ruby program which is slow for you, feel free to
>>send me that :) Perhaps, YARV will be optimized for your
>>application.
>
>
> Not that it is a valuable application... but I have this dumb example of
> using backtracking to solve the map coloring problem as found here:
> http://www.ccs.neu.edu/home/dorai/t-y-scheme/t-y-scheme-Z-H-16.html#node_...
>
> It stresses callcc a lot and takes ~15 seconds to terminate on my old
> athlon 2000 box.
> If you want take a look at it at:
> http://rafb.net/paste/results/x4g...
>

btw, today I should study butwhen one is forced to do stuff, he revertes
to something else. So I get yarv and tried it on my winxp setup

[gcc version 3.2.3 (mingw special 20030504-1), athlon 2000+ today
snapshot from 1.9 and yarv at revision 77].

Did make test-all and got it run fine (even if there were some warnings
in the compilation)
Then I stuffed my code as bm_4col.rb in the benchmark/ dir and launched
make bench. I got a crash on my code[1], but, well, I didn't expect it
to work :).
Results for other benchmarks are really impressive tough.
(i.e. the ackermann function timing is :
ruby 2.493000 0.010000 2.503000 ( 2.624000)
yarv 0.250000 0.000000 0.250000 ( 0.261000)
)

If someone's curious I've put them at:
ada2.unipv.it/~riffraff/bench.log.gz





[1]
../benchmark/bm_4col.rb:93: [BUG] BUG: unknown node: NODE_MASGN
ruby 1.9.0 (2004-12-03) [i386-mingw32]

gabriele renzi

12/3/2004 5:47:00 PM

0

gabriele renzi ha scritto:

further note:
make test-all from time to time gives:


c:/ruby/lib/ruby/1.9/test/unit/util/backtracefilter.rb:16: [BUG]
Segmentation fault
ruby 1.9.0 (2004-12-03) [i386-mingw32]


This application has requested the Runtime to terminate it in an unusual
way.
Please contact the application's support team for more information.
make: *** [test-all] Error 3

SASADA Koichi

12/6/2004 2:07:00 AM

0

Hi,

Florian Gross wrote:
> SASADA Koichi wrote:
>
>> I already use that:)
>> http://www.atdot.net/svn/yarv/trunk/...
>
>
> Interesting, is the speedup in percent available somewhere?
>

today's result:
http://www.atdot.net/yarv/bench_20...

Regards,
SASADA Koichi

SASADA Koichi

12/6/2004 2:09:00 AM

0

Hi,

> I don't know if this is what you are looking for or not, but Needle
> (http://rubyforge.org/proje...) has a 'benchmarks' subdirectory
> with a handful of different benchmarks.
>
> If you manage to get them to run under YARV, I'd love to see the results. :)
>
> - Jamis
>

I'll try it if 'require' is implemented.

Thanks,
SASADA Koichi

SASADA Koichi

12/6/2004 2:18:00 AM

0

Hi,

> btw, today I should study butwhen one is forced to do stuff, he revertes
> to something else. So I get yarv and tried it on my winxp setup
>
> [gcc version 3.2.3 (mingw special 20030504-1), athlon 2000+ today
> snapshot from 1.9 and yarv at revision 77].
>
> Did make test-all and got it run fine (even if there were some warnings
> in the compilation)
> Then I stuffed my code as bm_4col.rb in the benchmark/ dir and launched
> make bench. I got a crash on my code[1], but, well, I didn't expect it
> to work :).
> Results for other benchmarks are really impressive tough.
> (i.e. the ackermann function timing is :
> ruby 2.493000 0.010000 2.503000 ( 2.624000)
> yarv 0.250000 0.000000 0.250000 ( 0.261000)
> )
>
> If someone's curious I've put them at:
> ada2.unipv.it/~riffraff/bench.log.gz

I'll try to run your program.

Thanks,
SASADA Koichi