I am reading Cucker and Zhou’s “Learning Theory: An Approximation Theory Viewpoint”. I am trying to understand the accuracy versus precision separation in Digital Elevation Models (DEMs) by looking at how the bias/variance decomposition is done. Are these two different ways of decomposing error isomorphic? Is accuracy the same as bias, precision variance? I don’t think so. The accuracy error in a DEM could be defined by considering translations and other operations such as rotations and shearing. These operations being global could be used to define what one wants to call the accuracy of a model. What remains after these global operations would then be the precision error. This view of error decomposition means that it is not possible to look at something like the average error over a DEM and blindly state that it can also be decomposable into an accuracy and precision part. This is only possible for height estimates that have no uncertainty in their x,y locations. This is the case for the autonomous difference equations we described in the 8th Optical 3D conference. They are invariant under arbitrary rotations and rotations about axes that are parallel to the z-axis.
Getting back to Cucker and Zhou’s book. I found the following comment about “probably approximately correct” PAC learning interesting: “Extensions of PAC learning allowing for labeling mistakes with small probability exist.” Thus the “probably” part of PAC error estimates assumes that you have perfect training data. This is just another example of how little we know about error and how to properly take it into account in our estimation algorithms.
In the case of the DEM models, the autonomous difference equations can only detect an error that is invariant under the abelian operations of translations and rotations about a single axis. If I tried to decompose the height error taking into account x,y uncertainty — I would find that the average error is not decomposable into separable parts. Somehow, one must be able to express this non-separability as being technically due to the non-abelian character of 3D rotations.