Issue 128487

Summary: Dimension line - numerical artefact
Product: General Reporter: Czesław Wolański <czeslaw.wolanski>
Component: uiAssignee: AOO issues mailing list <issues>
Status: UNCONFIRMED --- QA Contact:
Severity: Trivial    
Priority: P5 (lowest) CC: knmc
Version: 4.1.11   
Target Milestone: ---   
Hardware: PC   
OS: Windows 7   
Issue Type: DEFECT Latest Confirmation in: ---
Developer Difficulty: ---
Attachments:
Description Flags
Example of numerical artefact none

Description Czesław Wolański 2021-10-15 15:50:00 UTC
Created attachment 87058 [details]
Example of numerical artefact

Steps to reproduce:

1. In Draw/Impress insert a dimension line.
2. In the context menu of the dimension line, choose "Dimensions...".
3. In the Dimensioning dialog increase stepwise the value of "Decimal places"
   and observe the Preview field (the default value by two decimal places is
   5.73 " and the upper limit of decimal places is 99).

Decimal    Preview field
places     [inch]

2          5.73
3          5.73
4          5.7299
5          5.72992
6          5.729921
7          5.7299213
8          5.72992126
9          -2.147483648

Notice that: 2^31 = 2,147,483,648
Continuing the "exercise"...

10         -.2147483648
11         0.-2147483648
12         0.0-2147483648

and so on...

However the effect not limited to the Preview field in the Dimensioning dialog.

4. Close the Dimensioning dialog.
5. Set the width of the dimension line to 5 inches (I used that value
   in the attached .odg file) and increase the number of decimal places
   via the Dimensioning dialog.

   Observe the effect starting with 9 decimal places.


Expected result: no numerical artefacts

Question: what it the rationale behind such a large allowable number
of decimal places i.e. 99?