Refine
Document Type
- Doctoral thesis (2)
Has Fulltext
- yes (2)
Is part of the Bibliography
- no (2)
Year of publication
- 2018 (2)
Language
- English (2)
Keywords
- Maschinelles Sehen (2) (remove)
Institute
The main part of the research outlined in this thesis is to develop Deep Learning models for the linguistic interpretation of the visual contents. This part is split into two research problems: interactive region segmentation and captioning, and selective texture labeling. In the first attempt, we proposed a novel hybrid Deep Learning architecture whereby the user is able to specify an arbitrary region of the image that should be highlighted and described. The proposed model alternates the bounding box indications of the standard object localization process with the output of a deep interactive segmentation module to achieve a better understanding of the dense image captioning and improve the object localization accuracy. The idea of the next part is to establish a bidirectional correlation between deep texture representation and its linguistic description via a hybrid CNN-RNN model that enables end-to-end learning of the selective texture labeling. This novel architecture provides new opportunities to describe, search, and also retrieve texture images from their linguistic descriptions. To be able to train such a model, we generated a multi-label texture dataset that covers color, material, and pattern labeling simultaneously. Our contribution to the automatic generation of texture descriptions provides an excellent opportunity to enrich the existing vocabulary of the image captioning. Such a conceptual extension can be used for fine-grained captioning applicable in geology, meteorology and other natural sciences where fine-grained image structures are of importance to understand complicated patterns. Apart from Deep Learning technologies, in the final section of the thesis, we proposed a novel approach to define mathematical morphology on color images. To this end, we converted common RGB-values of the color images into a new biconal color space and then combined two approaches of mathematical morphology to give meaning to the maximum and the minimum of the matrix field data and formulate our novel strategy.
Reconstruction of the 3D shape information is a fundamental problem in computer vision. Among different shape recovering technologies, photometric stereo is highlighted for its capability to produce high quality 3D reconstruction. This dissertation generalizes photometric stereo in different aspects towards creating a practical 3D reconstruction. The proposed techniques can be considered as a fundamental support to develop future cameras offering 3D shapes for various applications such as movie and video game industry, medical sciences, virtual reality, automotive driving and etc. The first generalization is developed for addressing specularities in 3D reconstructions and also involving the perspective projection. These attempts lead to remove the limitation of working with diffuse materials and confined projected scenes. We will prove the applicability of our approach using complex scenes like endoscopy images. In the second proposed approach, we will offer a real-time 3D reconstruction of micro-details with a more generalized reflectance model. Moreover, a recurrent optimization network will be provided. These innovations lead to presenting the 3D reconstruction of details which are even invisible to human eyes like micro-prints on the banknote. This information recovery can be used in various areas such as detecting security items on financial documents for fraud detection and also the quality control of any industrial productions including delicate details such as printed circuits. In the third proposed model, we develop a PS reconstruction technique using neural networks for the uncalibrated PS where the light direction is not available. Finally, for the first time, benefiting from deep neural networks and meta heuristic algorithms, we will devise an approach which can deliver high qualified 3D shape from the internet and out-door images, without any pre-necessary knowledge.