The ultrasonic polar scan (UPS), either in transmission, reflection or backscatter mode, is a promising non-destructive testing technique for the characterization of composites, providing information about the mechanical anisotropy, the viscoelastic damping, the surface roughness, and more. At present, the technique is merely being used for qualitative purposes. The limited quantitative exploration and use of the technique can be primarily ascribed to limitations of current theoretical models as well as the difficulty to perform accurate, and more importantly, reproducible UPS experiments. Over the last years, we have identified several potential pitfalls in the experimental implementation of the technique which severely deteriorate the accurateness and reproducibility of a UPS. In this paper, we make an inventory of the most important difficulties, illustrate each of them by a real experiment and present a feasible mediation, either numerical or experimental in nature. Once the experimental set-up is fine-tuned to overcome these pitfalls, it is expected that the recording of high-level UPS experiments, in combination with numerical computations, will facilitate the technique to become a fully quantitative non-destructive characterization method. (C) 2014 Elsevier B.V. All rights reserved.