IMAGE ANALYSIS AND COMPUTER VISION

Introduction

On this page, you will find all relevant information regarding your Image Analysis and Computer Vision course, taught by Prof. Luc Van Gool and Prof. Ender Konukoglu.

Content

This course aims at offering a self-contained account of computer vision and its underlying concepts, including the recent use of deep learning. The first part starts with an overview of existing and emerging applications that need computer vision. It shows that the realm of image processing is no longer restricted to the factory floor, but is entering several fields of our daily life. First the interaction of light with matter is considered. The most important hardware components such as cameras and illumination sources are also discussed. The course then turns to image discretization, necessary to process images by computer. The next part describes necessary pre-processing steps, that enhance image quality and/or detect specific features. Linear and non-linear filters are introduced for that purpose. The course will continue by analyzing procedures allowing to extract additional types of basic information from multiple images, with motion and 3D shape as two important examples. Finally, approaches for the recognition of specific objects as well as object classes will be discussed and analyzed. A major part at the end is devoted to deep learning and AI-based approaches to image analysis. Its main focus is on object recognition, but also other examples of image processing using deep neural nets are given.

Objective

Overview of the most important concepts of image formation, perception and analysis, and Computer Vision. Gaining own experience through theoretical and programming exercises.

Prerequisites

Basic concepts of mathematical analysis and linear algebra. The programming part of the exercises is based on Python and Linux. The course language is English.

Performance Assessment

Different parts of the lecture will be assessed in a maximum 2 hours written exam in English. Doctoral students who participate at the course to earn ECTS points will receive a “Testat” without taking the written examination if their department rules allow this and provided they successfully complete the three lab exercises (interim oral examination). All other students must take the written examination.

Lectures

The lectures will be pre-recorded and uploaded online on Moodle. There will be NO live-streaming of the lectures.

Exercises

The course includes three lab exercises. The exercises are mandatory only for students who want to receive a "Testat". The exercise sessions will take place online every thursday from 17:15 to 19:00. The TAs will be available online during this time to answer questions via Zoom. The Zoom links for the available TAs will be shared here. Please check the lab instruction slides for more details about the lab exercises.

Testat guidelines

If you are a doctoral student who want to receive a “Testat”, you need to register for the same before 30/09/2020. You can register by sending a mail with subject “[IACV2020] Testat registration” to goutam.bhat@vision.ee.ethz.ch. The testat students must give a short demo of your solution to the lab exercises to one of the TAs before the corresponding lab deadline. All the exercises have theoretical and programming parts. You will discuss the theoretical parts verbally with the assistants and you will be asked to give a short demo of your working solutions to the programming parts. You need to provide a satisfactory answer to each theoretical question AND demonstrate that your programs work as expected in order for your solution to be deemed complete. To make sure that the presentation process runs as efficiently as possible, only attempt to present once you have everything in working order. Please check the slides for more details about the registration and grading of the exercises for Testat students.

Script

The script for the course will be made available soon.

Lecture Slides

List of lecture slides for the course (will be updated during the course of the semester):

Week #

Slides

1

HS20: Introduction, Cameras & Illumination

2

HS20: Digital Image Formation

3

HS20: Sampling / Image Enhancement

4

HS20: Color & Texture

5

HS20: Feature Extraction

6

HS20: Unitary Transforms

7

HS20: Segmentation (Deformable Shapes)

8

HS20: Optical Flow and 3D

9

HS20: 3D (same slides as week #8 - 2nd part)

10

HS20: Traditional Object Recognition

11

HS20: Tracking

12

HS20: Deep Learning I (ppt version)

13

HS20: Deep Learning II (ppt version)

14

HS20: Deep Learning III

Old

Slides from previous years

Exercises

In the first exercise session on 17.09.2020, you will be guided through an introductory programming task in Python called Exercise 0. Thereafter, you will be provided with the regular exercises handouts. The handout of each exercise will be posted after the deadline of the previous exercise has passed. The solution code and a solution sheet for each exercise will be posted after its deadline has passed.

Note Due to limited number of seats in the lab, you will need to register in advance here if you wish to attent the lab sessions. The TAs will also be available online during this time to answer questions via Zoom. The exact timings and the Zoom links for the available TAs will be shared here.

#

Exercise Sheet and Required Material

Deadline

Solution

0

Introduction to Python [Material]

None

Practical

1

Basic Image Processing

22.10.2020

Theoretical+Practical

2

Stereo Vision

12.11.2020

Theoretical+Practical

3

Image Classification [Extra material] [PyTorch intro]

17.12.2020

Theoretical+Practical

Extra material: example images that are used as input for the programming parts of the exercises. You can download all images as a zip file here.

Working Remotely

Please check the lab instruction slides for instructions about working remotely or setting up the lab environment on your own laptop.

Responsible Assistants

If you have any questions, please feel free to email the responsible assistants for the exercise that your questions pertain to. Below is the list of assistants who will be helping you out with the exercises.

Exercise

Assistants

Exercise 0

Goutam, Christos,

Exercise 1

Goutam, Xiaoran Prune, Jingyun, Yigit

Exercise 2

Christos, Goutam, Anton, Xiaoran, Janis

Exercise 3

Christos, Anton, Prune, Yigit, Jingyun

Exam instructions

As to the material that has to be studied for the exam of HS20, you should use the slide decks made available to you for this year's lectures as the reference. The material in there has to be studied. The course script can be used in as far as you find it useful to further explain what is in the slides. Material in the course script that is not covered by the slides does not have to be studied.

Example exam questions can be found here.



Contract All | Expand All