Abstract: The Brinell hardness measurement methods currently used were analyzed. The advantages and disadvantages of traditional optical measurement method, depth masuring method, measurement method based on image processing technology and measurement method based on deep learning were described respectively. The results show that all kinds of measurement methods have their own advantages, but they also have limitations. The traditional optical measurement method needs manual operation, which has human error and low efficiency. Although depth measuring method has been proved to be feasible, it has not been widely verified. The automatic measurement system based on image processing technology has good advantages in the accuracy and efficiency of measurement results, but it still has limitations for samples with rough surface and no obvious indentation. With the development of computer technology, the measurement method based on deep learning shows good advantages in various aspects, and this method will become the focus of the future research on Brinell hardness automatic measurement system.