پیوندهای مفید
اخبار و اعلانات
آمار
| تعداد نشریات | 13 |
| تعداد شماره‌ها | 200 |
| تعداد مقالات | 2,008 |
| تعداد مشاهده مقاله | 2,680,113 |
| تعداد دریافت فایل اصل مقاله | 1,937,340 |
Hybrid Convolutional Neural Network with Domain adaptation for Sketch based Image Retrieval | ||
| Journal of Electrical and Computer Engineering Innovations (JECEI) | ||
| مقالات آماده انتشار، پذیرفته شده، انتشار آنلاین از تاریخ 12 تیر 1403 | ||
| نوع مقاله: Original Research Paper | ||
| شناسه دیجیتال (DOI): 10.22061/jecei.2024.10778.735 | ||
| نویسندگان | ||
| A. Gheitasi؛ H. Farsi؛ S. Mohamadzadeh* | ||
| Department of Electrical and Computer Engineering, University of Birjand, Birjand, Iran. | ||
| تاریخ دریافت: 03 فروردین 1403، تاریخ بازنگری: 28 خرداد 1403، تاریخ پذیرش: 09 تیر 1403 | ||
| چکیده | ||
| Background and Objectives: Freehand sketching is an easy-to-use but effective instrument for computer-human connection. Sketches are highly abstract to the domain gap, that exists between the intended sketch and real image. In addition to appearance information, it is believed that shape information is also very efficient in sketch recognition and retrieval. Methods: In the realm of machine vision, comprehending Freehand Sketches has grown more crucial due to the widespread use of touchscreen devices. In addition to appearance information, it is believed that shape information is also very efficient in sketch recognition and retrieval. The majority of sketch recognition and retrieval methods utilize appearance information-based tactics. A hybrid network architecture comprising two networks—S-Net (Sketch Network) and A-Net (Appearance Network)—is shown in this article under the heading of hybrid convolution. These subnetworks, in turn, describe appearance and shape information. Conversely, a module known as the Conventional Correlation Analysis (CCA) technique module is utilized to match the range and enhance the sketch retrieval performance to decrease the range gap distance. Finally, sketch retrieval using the hybrid Convolutional Neural Network (CNN) and CCA domain adaptation module is tested using many datasets, including Sketchy, Tu-Berlin, and Flickr-15k. The final experimental results demonstrated that compared to more sophisticated methods, the hybrid CNN and CCA module produced high accuracy and results. Results: The proposed method has been evaluated in the two fields of image classification and Sketch Based Image Retrieval (SBIR). The proposed hybrid convolution works better than other basic networks. It achieves a classification score of 84.44% for the TU-Berlin dataset and 82.76% for the sketchy dataset. Additionally, in SBIR, the proposed method stands out among methods based on deep learning, outperforming non-deep methods by a significant margin. Conclusion: This research presented the hybrid convolutional framework, which is based on deep learning for pattern recognition. Compared to the best available methods, hybrid network convolution has increased recognition and retrieval accuracy by around 5%. It is an efficient and thorough method which demonstrated valid results in Sketch-based image classification and retrieval on TU-Berlin, Flickr 15k, and sketchy datasets. | ||
| کلیدواژه‌ها | ||
| Sketch Based Image Retrieval (SBIR)؛ Hybrid CNN؛ Domain Adaptation؛ Deep Learning | ||
|
آمار تعداد مشاهده مقاله: 36 |
||