A Benchmark for Homework Tidiness Assessment

The homework tidiness assessment aims to auto evaluate the writing tidiness of homework, playing an important role in daily teaching. However, there is still no comprehensive basis for homework tidiness assessment. For this, a benchmark for homework tidiness assessment (HTA) is proposed. Firstly, a database named HTA 1.0 containing 1000 homework images is collected. Each image is manually annotated by multiple volunteers. Secondly, a comprehensive evaluation protocol is designed, using mean absolute error (MAE), root mean square error (RMSE), mean absolute percentage error (MAPE) and accuracy (Acc) as performance indicators. Finally, three deep learning models (i.e., LeNet, AlexNet and VGGNet) are applied as baseline methods and the results are reported and analyzed.