math/big: improve threshold calibration #25580
Labels
NeedsInvestigation
Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Performance
Milestone
For multiplication and squaring we use different algorithms depending on the input length. We currently have 3 threshold constants to decide which algorithm to use. These are calibrated with TestCalibrate.
This calibration takes multiple minutes to run and the outcome doesn't seem to be that reliable. Last noticed in cl 105075.
Quote @griesemer :
I see three issues:
karatsubaSqrThreshold
we got differences of more than 100% between our 3 machinesThe text was updated successfully, but these errors were encountered: