microsoft.public.dotnet.framework

What algorithm is used for rounding when doing a narrowing conversion between floating point numeric types?

Nathan Sokalski

10/19/2008 5:03:00 PM

When doing one of the following conversions (I know that data can be lost
and all those compiler warnings), what algorithm is used to determine the
value returned:

Converting Double to Single
Converting Decimal to Double
Converting Decimal to Single

Is this algorithm different for CType, CSng, CDbl, or the System.Convert
methods? Thanks.
--
Nathan Sokalski
njsokalski@hotmail.com
http://www.nathansok...

microsoft.public.dotnet.framework

What algorithm is used for rounding when doing a narrowing conversion between floating point numeric types?

Nathan Sokalski

x Login to ForumsZone