Decimal Conversion

 

ROUNDING RULE

When the tool size starts from an inch fractional, the "Rounding Rule" applies. Specifically, the inch decimal conversion of the sixteen sizes with 32 in their denominator up to 1" are 5 place decimals which end in the number 5. On a 32nd of an inch size with the fifth digit a 5 and the fourth digit an even number the fourth digit is not rounded up (i.e. 15/32" = .531250" becomes .5312"). If the fifth digit is a 5 but the fourth digit is an odd number, the fourth digit is rounded up (i.e. 3/32" = .093750" becomes .0938").

Computer rounding to a four decimal place number will not always match these decimal equivalents because the computer math processor will always round the number up one number if the next number in the decimal place is a 5. This is also the case when starting from a metric size (i.e. 1.5mm = .059055" = .0591").

 

Inch Frac. Inch Dec. Wire # mm Equiv.     Inch Frac. Inch Dec. Wire # mm Equiv.     Inch Frac. Inch Dec. Wire/ Letter mm Equiv.
Micron 0.000039   0.001   .0980 40 2.489   .1910 11 4.851
  0.000315   0.008   .0984   2.5   .1929   4.9
  0.0004   0.01   .0995 39 2.527   .1935 10 4.915
  0.0039   0.1   .1015 38 2.578   .1960 9 4.678
  0.0135 80 0.343   .1040 37 2.642   .1969   5.0
  0.0145 79 0.368   .1065 36 2.705   .1990 8 5.055
1/64 0.0156   .396 7/64 .1094   2.779   .2008   5.1
  0.0160 78 .406   .1100 35 2.794   .2010 7 5.105
  0.0180 77 .457   .1110 34 2.819 13/64 .2031   5.159
  .0197   .5   .1130 33 2.87   .2040 6 5.182
  .0200 76 .508   .1142   2.9   .2047   5.2
  .0210 75 .533   .1160 32 2.946   .2055 5 5.22
  .0225 74 .572   .1181   3.0   .2067   5.25
  .0240 73 .610   .1200 31 3.048   .2087 4 5.3
  .0250 72 .635   .1220   3.1   .2090   5.309
  .0260 71 .660 1/8 .1250   3.175   .2126 3 5.4
  .0280 70 .711   .1260   3.2   .2130   5.41
  .0292 69 .742   .1285 30 3.264   .2165   5.5
  .0310 68 .787   .1299   3.3 7/32 .2188   5.558
1/32 .0312   .792   .1339   3.4   .2205   5.6
  .0320 67 .813   .1360 29 3.454   .2210 2 5.613
  .0330 66 .838   .1378   3.5   .2244   5.7
  .0350 654 .889   .1405 28 3.569   .2280 1 5.791
  .0360 64 .914 9/64 .1406   3.571   .2283   5.8
  .0370 63 .940   .1417   3.6   .2323   5.9
  .0380 62 .965   .1440 27 3.658   .2340 A 5.944
  .0390 61 .991   .1457   3.7 15/64 .2344   5.954
  .0394   1.0   .1470 26 3.734   .2362   6.0
  .0400 60 1.016   .1495 25 3.797   .2380 B 6.045
  .0410 59 1.041   .1496   3.8   .2402   6.1
  .0420 58 1.067   .1520 24 3.861   .2420 C 6.147
  .0430 57 1.092   .1535   3.9   .2441   6.2
  .0465 56 1.181   .1540 23 3.912   .2460 D 6.248
3/64 .0469   1.191 5/32 .1562   3.967   .2480   6.3
  .0520 55 1.321   .1570 22 3.988 1/4 .2500 E 6.35
  .0550 54 1.397   .1575   4.0   .2520   6.4
  .0591   1.5   .1590 21 4.039   .2559   6.5
  .0595 53 1.511   .1610 20 4.089   .2570 F 6.528
1/16 .0625   1.588   .1614   4.1   .2598   6.6
  .0635 52 1.613   .1624   4.125   .2610 G 6.629
  .0670 51 1.702   .1654   4.2   .2630   6.68
  .0700 50 1.778   .1660 19 4.216   .2638   6.7
  .0730 49 1.854   .1693   4.3 17/64 .2656   6.746
  .0760 48 1.93   .1695 18 4.305   .2660 H 6.756
5/64 .0781   1.984 11/64 .1719   4.366   .2677   6.8
  .0785 47 1.994   .1730 17 4.394   .2697   6.85
  .0787   2.0   .1732   4.4   .2717   6.9
  .0810 46 2.057   .1770 16 4.496   .2720 I 6.909
  .0820 45 2.083   .1772   4.5   .2756   7.0
  .0827   2.1   .1800 15 4.572   .2770 J 7.036
  .0860 44 2.184   .1811   4.6   .2795   7.1
  .0890 43 2.261   .1820 14 4.623   .2810 K 7.137
  .0925   2.35   .1850 13 4.7 9/32 .2812   7.142
  .0935 42 2.375 3/16 .1875   4.763   .2835   7.2
3/32 .0938   2.383   .1890 12 4.801   .2874   7.3
  .0960 41 2.438                

 

Inch Frac. Inch Dec. Ltr mm Equiv.  

     

Inch Frac. Inch Dec. mm Equiv.  

     

Inch Frac. Inch Dec. mm Equiv.
  .2900 L 7.366   .4173 10.6 23/32 .7188 18.258
  .2913   7.4   .4213 10.7   .7283 18.5
  .2950 M 7.493 27/64 .4219 10.716 47/64 .7344 18.654
  .2953   7.5   .4252 10.8   .7480 19.0
19/64 .2969   7.541   .4291 10.9 3/4 .7500 19.05
  .2992   7.6   .4311 10.95 49/64 .7656 19.446
  .3020 N 7.671   .4331 11.0   .7677 19.5
  .3031   7.7   .4370 11.1 25/32 .7812 19.842
  .3071   7.8 7/16 .4375 11.113   .7874 20.0
  .3110   7.9   .4409 11.2 51/64 .7969 20.241
5/16 .3125   7.938   .4449 11.3   .8071 20.5
  .3150   8.0   .4488 11.4 13/16 .8125 20.638
  .3160 O 8.026   .4528 11.5   .8268 21.0
  .3189   8.1 29/64 .4531 11.509 53/64 .8281 21.034
  .3228   8.2   .4567 11.6 27/32 .8438 21.433
  .3230 P 8.204   .4606 11.7   .8465 21.5
  .3268   8.3   .4646 11.8 55/64 .8594 21.829
21/64 .3281   8.334   .4685 11.9   .8661 22.0
  .3307   8.4 15/32 .4688 11.908 7/8 .8750 22.225
  .3320   8.433   .4724 12.0   .8858 22.5
  .3346   8.5   .4764 12.1 57/64 .8906 22.621
  .3370   8.560   .4803 12.2   .9055 23.0
  .3386   8.6 31/64 .4844 12.304 29/32 .9062 23.017
  .3390 R 8.611   .4882 12.4 59/64 .9219 23.416
  .3425   8.7   .4921 12.5   .9252 23.5
11/32 .3438   8.733   .4961 12.6 15/16 .9375 23.813
  .3465   8.8 1/2 .5000 12.7   .9449 24.0
  .3480 S 8.839   .5039 12.8 61/64 .9531 24.209
  .3504   8.9   .5079 12.9   .9646 24.5
  .3543   9.0   .5118 13.0 31/32 .9688 24.608
  .3580 T 9.093 33/64 .5156 13.096   .9843 25.0
  .3583   9.1 17/32 .5312 13.492 63/64 .9844 25.004
23/64 .3594   9.129   .5315 13.5 1 1.0000 25.4
  .3622   9.2 35/64 .5469 13.891   1.0039 25.5
  .661   9.3   .5512 14.0      
  .3680 U 9.347   .5571 14.15      
  .3701   9.4 9/16 .5625 14.288      
  .3740   9.5   .5709 14.5      
3/8 .3750   9.525 37/64 .5781 14.684      
  .3770 V 9.576   .5906 15.0      
  .3780   9.6 19/32 .5938 15.083      
  .3819   9.7 39/64 .6094 15.479      
  .3858   9.8   .6102 15.5      
  .3860 W 9.804 5/8 .6250 15.875      
  .3898   9.9   .6299 16.0      
25/64 .3906   9.921 41/64 .6406 16.271      
  .3937   10.0   .6496 16.5      
  .3970 X 10.084 21/32 .6562 16.667      
  .3976   10.1   .6594 16.75      
  .4040 Y 10.262   .6693 17.0      
  .4055   10.3 43/64 .6719 17.066      
13/32 .4062   10.317 11/16 .6875 17.463      
  .4094   10.4   .6890 17.5      
  .4130 Z 10.49 45/64 .7031 17.859      
  .4134   10.5   .7087 18.0      

© CJT Koolcarb, Inc. 1996. All rights reserved.
No part of this publication may be reproduced without the express written permission of the officers of CJT Koolcarb, Inc.

 

 
INDEX

Last Updated on 11/14/01
By Bob Novak Media Development
Copyright Ó1999 CJT KOOLCARB Inc.