Thesis Defense - Osman Furkan Kınlı (MSCS)

Osman Furkan Kınlı- M.Sc. Computer Science

Asst.Prof. Furkan Kıraç - Advisor

CLOTHING IMAGE RETRIEVAL WITH TRIPLET
CAPSULE NETWORKS

Date: 19.08.2019

Time: 15:00

Location: AB1 412

Thesis Committee: 

Asst. Prof. Furkan Kıraç,  Özyeğin University

Asst. Prof. Reyhan Aydoğan,  Özyeğin University

Prof. Lale Akarun, Boğaziçi University

Abstract

Clothing image retrieval has become more important after some major developments in Computer Science and the emergence of e-commerce. Recent studies generally attack to this problem by using Convolutional Neural Networks (CNNs). Despite its popularity, CNNs, by their nature, have some intrinsic limitations such as losing the hierarchical spatial relationship between the parts of an image and being not robust to affine transformations. Most recently proposed network architecture, namely Capsule Networks, has the ability to overcome these limitations by preserving the part-whole relationship and pose information in the images. In this thesis, we investigate the in-shop clothing retrieval performance of densely-connected Capsule Networks with dynamic routing. To achieve this, we propose Triplet-based designs of Capsule Network architecture with two different feature extraction methods: Stacked-convolutional (SCCapsNet) and Residual-connected (RCCapsNet) Capsule Networks. Experimental results of our proposed designs on in-shop clothing retrieval show that SCCapsNet achieves 32.1\% Top-1, 81.8\% Top-20, and 90.0\% Top-50 recall-at-K scores; whereas RCCapsNet has even better performance with 33.9\% Top-1, 84.6\% Top-20, and 92.6\% Top-50 recall-at-K scores. These figures demonstrate that both of our designs outperform the baseline study and the earlier approaches by a wide margin without using any extra supportive information besides to the images. Moreover, when compared to the SOTA architectures on clothing retrieval, our proposed Triplet Capsule Networks achieve comparable recall rates with only half of the parameters used in the SOTA architectures. In the future, our designs may inherit extra performance boost due to advances in the relatively new Capsule Network research. 

Bio

Osman Furkan Kınlı was born in Aydın, Turkey. He received B.Sc. degree in Department of Computer Science at Özyeğin University İstanbul, Turkey. He is working as a Research Assistant in Computer Science department of the same institution. Currently, He is pursuing M.Sc. of Artificial Intelligence at Özyeğin University İstanbul, Turkey. Main research interests include Computer Vision, Deep Learning, particularly Capsule Networks.