Towards accurate price tag recognition algorithm with multi-task RNN
-
摘要: 为了促进智能新零售在线下业务场景的发展, 提高作为销售关键信息价格牌的识别精度. 本文对价格牌识别问题进行研究, 有效地提高了价格牌的识别精度, 并解决小数点定位不准确的难题. 通过深度卷积神经网络提取价格牌的深度语义表达特征, 将提取到的特征图送入多任务循环网络层进行编码, 然后根据解码网络设计的注意力机制解码出价格数字, 最后将多个分支的结果整合并输出完整价格. 本文所提出的方法能够非常有效的提高线下零售场景价格牌的识别精度, 并解决了一些领域难题如小数点的定位问题, 此外, 为了验证本文方法的普适性, 在其他场景数据集上进行了对比实验, 相关结果也验证了本文方法的有效性.Abstract: In order to promote the development of smart new retail in the offline scenario and improve the recognition accuracy of price tags, which as a key sales information, this paper studies this application scene to improve the recognition accuracy effectively of the price tag and solves the difficulty of locating decimal point. The deep semantic expression features of price tag are extracted by deep convolutional neural network, sent to the multi-task recurrent network layer for encoding, and then the price number is decoded according to the attention mechanism of the decoding network, and finally the results of multiple branches are integrated to output the complete price. The method we proposed can effectively improve the price recognition accuracy in the smart new retail scenario and solve some challenge problem such as locating the position of decimal point. In addition, in order to verify the universality of the method, comparative experiments are carried out on datasets of other scenarios, and the related results also verify the effectiveness of the method in this paper.
-
表 1 模块的研究
Table 1 Study of modules
Model General-data Hard-data VGG-BiLSTM-CTC 50.20% 20.20% VGG-BiLSTM-Attn 61.20% 38.60% ResNet-BiLSTM-CTC 55.60% 28.80% ResNet-BiLSTM-Attn 68.10% 41.40% 
下载: 导出CSV
-
[1] 1 Shi B, Bai X, Yao C. An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE transactions on pattern analysis and machine intelligence, 2016, 39(11): 2298−2304 [2] Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Polosukhin I. Attention is all you need//Advances in neural information processing systems. 2017: 5998−6008 [3] Luong M T, Pham H, Manning C D. Effective approaches to attention-based neural machine translation. arXiv preprint arXiv: 1508.04025, 2015 [4] Li H, Wang P, Shen C. Towards end-to-end text spotting with convolutional recurrent neural networks//Proceedings of the IEEE International Conference on Computer Vision. IEEE, 2017: 5238−5246 [5] Yuan X, He P, Li X A. Adaptive adversarial attack on scene text recognition. arXiv preprint arXiv: 1807.03326, 2018 [6] Graves A, Fernández S, Gomez F, Schmidhuber J. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks//Proceedings of the 23rd international conference on Machine learning. ACM, 2006: 369−376 [7] 7 Sutskever I, Vinyals O, Le Q V. Sequence to sequence learning with neural networks. Advances in neural information processing systems, 2014, : 3104−3112 [8] 8 Lei Z, Zhao S, Song H, Shen J. Scene text recognition using residual convolutional recurrent neural network. Machine Vision and Applications, 2018, 29(5): 861−871 doi: 10.1007/s00138-018-0942-y [9] Shi B, Yang M, Wang X, Lyu P, Yao C, Bai X. Aster: An attentional scene text recognizer with flexible rectification. IEEE transactions on pattern analysis and machine intelligence, 2018 [10] Long M, Wang J. Learning multiple tasks with deep relationship networks. arXiv preprint arXiv: 1506.02117, 2015, 2 [11] Veit A, Matera T, Neumann L, Matas J, Belongie S. Coco-text: Dataset and benchmark for text detection and recognition in natural images. arXiv preprint arXiv: 1601.07140, 2016 [12] Karatzas D, Gomez-Bigorda L, Nicolaou A, Ghosh S, Bagdanov A, Iwamura M, Shafait F. ICDAR 2015 competition on robust reading//2015 13th International Conference on Document Analysis and Recognition (ICDAR). IEEE, 2015: 1156−1160 [13] Baek J, Kim G, Lee J, Park S, Han D. What is wrong with scene text recognition model comparisons? dataset and model analysis. arXiv preprint arXiv: 1904.01906, 2019 [14] Bingel J, Søgaard A. Identifying beneficial task relations for multi-task learning in deep neural networks. arXiv preprint arXiv: 1702.08303, 2017 [15] Xie Z, Huang Y, Zhu Y, Jin L, Liu Y, Xie L. Aggregation Cross-Entropy for Sequence Recognition// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2019: 6538−6547 [16] 16 Li H, Wang P, Shen C. Toward end-to-end car license plate detection and recognition with deep neural networks. IEEE Transactions on Intelligent Transportation Systems, 2018, 20(3): 1126−1136 [17] Xu Z, Yang W, Meng A, Lu N, Huang H, Ying C, Huang L. Towards End-to-End License Plate Detection and Recognition: A Large Dataset and Baseline// Proceedings of the European Conference on Computer Vision (ECCV). 2018: 255−271 -
点击查看大图
计量
- 文章访问数: 590
- HTML全文浏览量: 356
- 被引次数: 0
