There is trade-off between resolution and depth in convolutional neural networks. In fact, when we go deeper in the network we can find higher-level representations that are associated with higher semantic-level features. This is the main reason why a deeper layer is used as a feature extractor mechanism for different applications. However, deeper layers also are related with loss of resolution due to the underlying pooling layers, which make them inappropriate for dealing with small objects. A picture illustrating the opposite relation between resolution and semantic is shown in Figure 1.<\/p>\n
![\"Figure](\"https:\/\/impresee.com\/wp-content\/uploads\/2018\/08\/1_HJ8AqiN5wxZ_uU_iJ-x5Ew.png\")
Figure 1. Resolution vs Semantic<\/p><\/div>\n
With focus on leveraging the internal hierarchical representation of a convolutional neural network, we can construct a multi-scale architecture just by plugging a predictor into each internal layer as in Figure 2. We will call this Case A.<\/p>\n
![\"Figure](\"https:\/\/impresee.com\/wp-content\/uploads\/2018\/08\/1_np56aV-4LSLwbY2LrB8lkA.png\")
Figure 2. (Case A) Predictors are directly plugged into each convolutional layer.<\/p><\/div>\n
This solution is very simple, but it presents a critical weakness. There are many predictors relying on shallow layers which provide poor semantic information even though they are high-resolution.<\/p>\n
Another architecture is that of the Figure 3 that we will call Case B. In this case, high resolution layers are built from a deeper one. Although it seems that these new layers provide more information that the source layer, it is not the case. Actually, there is nothing new in those resized layers. Thus, if something was lost in the deeper layer, it will remain lost in the resized layers. Therefore the performance of the model using these layers will be similar to that using only the deeper one.<\/p>\n
![\"Figure](\"https:\/\/impresee.com\/wp-content\/uploads\/2018\/08\/1_hmdFtWLHgiR9Z6F9162Bvw.png\")
Figure 3. (Case B). Predictors are plugged into resized layers from a deeper one.<\/p><\/div>\n
To address the drawbacks showed by the previous cases we can produce a multi-scale representation combining higher semantic layers (lower resolution) with higher resolution layers (lower semantic). This proposal although recently described by the Feature Pyramid Network [1], was previously used for Semantic Segmentation [2]. We will call this new architecture Case C (see Figure 4). To this end, Case C works in a similar manner as Case B but the intermediate layers are generated with information obtained from higher resolution layers as shown in Figure 3. This allows us to take the benefits of the two worlds, one with higher resolution (shallow layers) and the other with higher semantic features (deep layers). The combination is carried out as in the ResNet architecture, just by adding the two layers. To make the addition feasible, 1×1 kernel-size convolutional layers are added before the addition using a fixed number of channels (e.g. 256). This proposal has shown outstanding performance in the object detection context overcoming state-of-the-art approaches.<\/p>\n
![\"Figure](\"https:\/\/impresee.com\/wp-content\/uploads\/2018\/08\/1__AexiZjs7q3977AcRu-pzw.png\")
Figure 4. (Case C). Predictors are plugged into layers that combine high resolution with high semantic .<\/p><\/div>\n
References<\/p>\n
[1] Tsung-Yi Lin, Piotr Doll\u00e1r, Ross Girshick, Kaiming He, Bharath Hariharan, Serge Belongie. Feature Pyramid Networks for Object Detection.<\/em><\/p>\n [2] Jonathan Long, Evan Shelhamer, Trevor Darrel. Fully Convolutional Networks for Semantic Segmentation.<\/em><\/p>","protected":false},"excerpt":{"rendered":" Convolutional neural networks have been widely used as a visual feature extractor mechanism in a diversity of tasks such as image retrieval, object segmentation, object detection, image classification, among others. In fact, after a convolutional network has been trained in a classification context, the internal neural units will have learned to appropriately respond to local […]<\/p>","protected":false},"author":1,"featured_media":1237,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[23],"tags":[57,58,13],"class_list":["post-1997","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-impresee-research-center","tag-convolutional-neural-networks","tag-research","tag-visual-search"],"yoast_head":"\n