[lnkForumImage]
TotalShareware - Download Free Software

Confronta i prezzi di migliaia di prodotti.
Asp Forum
 Home | Login | Register | Search 


 

Forums >

comp.lang.ruby

Jruby precision issue with reading float values in mysql db

Pradeep Gatram

5/27/2009 9:37:00 AM

Hi,

I was trying to upgrade from 1.1.6 to 1.2.0 and noticed a strange
issue with floats. In Jruby 1.2.0, a float like 2.52342 is read as
2.52342009544373 from the DB.

A few steps to reproduce this.
1. Migration: t.float :reading
2. Fixture: reading: 2.52342
3. Run script/console

jruby script/console
Loading development environment (Rails 2.2.2)
>> Foo.first.reading
=> 2.52342009544373

Any idea if this has been logged as a bug or if there is a workaround?
2 Answers

Pradeep Gatram

5/28/2009 6:33:00 AM

0

The issue persists with both 1.3.0 RC1 & RC2.

On May 27, 2:36 pm, Pradeep Gatram <pradeep.gat...@gmail.com> wrote:
> Hi,
>
> I was trying to upgrade from 1.1.6 to 1.2.0 and noticed a strange
> issue with floats. In Jruby 1.2.0, a float like 2.52342 is read as
> 2.52342009544373 from the DB.
>
> A few steps to reproduce this.
> 1. Migration:     t.float :reading
> 2. Fixture:        reading: 2.52342
> 3. Run script/console
>
> jruby script/console
> Loading development environment (Rails 2.2.2)>> Foo.first.reading
>
> => 2.52342009544373
>
> Any idea if this has been logged as a bug or if there is a workaround?

Charles Oliver Nutter

5/28/2009 5:20:00 PM

0

It seems the problem is that we're showing the actual machine precision
here. Floats are rarely 100% accurate, and this is likely a case where
it's losing some accuracy going into or coming out of the database. It's
possible there's a bug somewhere, but expecting floats to always be an
exact amount generally leads to bugs.

At any rate, can you file an issue for this in JRuby's bug tracker, and
if it's valid we'll try to fix it :)

Pradeep Gatram wrote:
> The issue persists with both 1.3.0 RC1 & RC2.
>
> On May 27, 2:36 pm, Pradeep Gatram <pradeep.gat...@gmail.com> wrote:
>> Hi,
>>
>> I was trying to upgrade from 1.1.6 to 1.2.0 and noticed a strange
>> issue with floats. In Jruby 1.2.0, a float like 2.52342 is read as
>> 2.52342009544373 from the DB.
>>
>> A few steps to reproduce this.
>> 1. Migration: t.float :reading
>> 2. Fixture: reading: 2.52342
>> 3. Run script/console
>>
>> jruby script/console
>> Loading development environment (Rails 2.2.2)>> Foo.first.reading
>>
>> => 2.52342009544373
>>
>> Any idea if this has been logged as a bug or if there is a workaround?
>
>