Computational Vision CLPS 1520

Computational Vision • Instructor: - Thomas Serre

• Teaching assistants: - David Mely (grad)

- Andrew Jones (undergrad)

Computer vision is forward-engineering (involves trying to engineer new visual systems) This course will be mostly about reverse-engineering

brain & cognitive 
 science

computer vision

Felleman & Van Essen 1991

image source: Chklovskii

What I cannot model, I do not understand. 
 Richard Feynman Can we create better seeing machines by imitating living brains?

Churchland & Sejnowski 1992

Deep learning

image source: http://www.persontyle.com/deep-learning-making-ai-intelligent-smarter

LeCun et al 2015, see also Google, Facebook, Microsoft, Baidu

Deep learning

• Microsoft now claims to surpass human accuracy on object recognition (He et al 2015) image source: wired.com

Neuroscience rocks! source: Cox & Dean 2015

Yet DL are limited! Beyond texture processing… correct classification

incorrect classification

source: Yann LeCun

Szegedy et al 2013, see also Nguyen et al 2014

Yet DL are limited!

B

B

A

C B

C

see Gulcehre & Bengio 2013, Fleuret et al 2014

B

C

B

C

A

B B

A A

C

Visual reasoning

A

A

Yet DL are limited! Beyond pattern recognition…

Yip & Sinha 2002

Yet DL are limited! Sample complexity

source: wired.com

bcs news

Source: Tenenbaum

Humans: learning from very few examples

By age 6, a child knows 10-30K categories

This course • Meet: 

- CIT 477 | TR 10:30–11:50 am

• Web:

- https://canvas.brown.edu/ courses/977995

• Communication:

- https://clps1520.slack.com

This course • My office hours: - Lecture content

- TR 1:00-2:00pm

- Metcalf #012 (my lab)

• TA office hours: - MATLAB + Assignments

- TBD

This course First half: Lectures + assignments

Models of the visual cortex

Second half: Advanced topics + final project

Real-world problems

Requirements and grading • Assignments (6 total): 45% • Exam: 25%

• Final project: 30%

• Participation + extra credit: extra 10%

• Your grade: 90-100 A, 80–90 B, 70–80 C, <70 NC

Exam • Study questions provided in advance

• Sample exam questions:

- Describe the two key computational mechanisms as well as relevant brain areas involved in the processing of invariant object recognition. Provide both a mathematical description of the operation as well as a sketch of the underlying circuitry. - Describe a computational theory of shape-from-texture and explain how it relates to each of Marr’s levels of analysis discussed in class. Provide one experimental method that could be used to test the proposed theory for each level of analysis.

Final project • Push the state-of-the-art by incorporating mechanisms of biological vision in deep learning architectures

• Test vision models on a robotic platform

- Making a working demo to be showcased

• Help automate science!

- Automated behavioral analysis, categorization of biological entities, etc

• Science communication project

Lectures • Slides and video recordings will be available online

• No textbook: Most of the readings will be optional readings to complement the lectures

Recommended books (available at the library)

(available online – free)

Recommended books (available at the library)

Recommended books (available at the library)

Is this course for you? • You have some programming background (at least one course involving programming — MATLAB or others)

• You have some working knowledge of linear algebra (vectors and matrixes)

• Or you are willing to do extra work (will provide support)

• You are interested in building computer vision systems that (1) work in real-world settings (i.e., robots) and (2) interested in helping me demonstrate that incorporating knowledge from biology yields systems that work better

• Knowledge of biological vision is not required

Is this course for you? • Gain computational thinking skills

• Build hacking skills

• Build toolkit (concepts, mathematical and computational methods) for modeling visual processes

• Understand key elements of biological vision and how they may help improve modern computer vision algorithms

Computational Vision

Computer vision is ... source: http://www.persontyle.com/deep-learning-making-ai-intelligent-smarter ... Slides and video recordings will be available online.

5MB Sizes 0 Downloads 338 Views

Recommend Documents

Computational Vision
Why not just minimizing the training error? • Never select a classifier using the test set! - e.g., don't report the accuracy of the classifier that does best on your test ...

Computational Vision
Gain control / normalization ... Increase in tolerance to position. Local max .... memory. Wallis & Bulthoff '01 but signif. The BG. L(10,4). 4A), alth mance on faces.

vision
The new sub-notebook computer employs a 233 MHz processor, 32 MB of RAM, 4 GB ... Page 9 ... Edge​ ​Detected​ ​Sub-notebook​ ​computer​ ​image.

pdf-1866\the-computational-brain-computational-neuroscience-by ...
... apps below to open or edit this item. pdf-1866\the-computational-brain-computational-neurosc ... -by-patricia-smith-churchland-terrence-j-sejnowski.pdf.

computational electromagnetics
the so-called Euler´s brachistochrone problem [Gould 1957]. ..... challenge on how we should educate the graduate students in this rapidly changing world. The.

computational abilities
The analysis of networks with strong backward coupling proved intractable. ..... This same analysis shows that the system generally fails in a "soft" fashion, with.

Computational Stereo
Another advantage is that stereo is a passive ... Computing Surveys, VoL 14, No. 4, December ...... conditions, cloud cover present in one im- age and not in the ...

Computational Stereo
For correspondence: S. T. Barnard, Artificial Intelligence Center, SRI ... notice is given that copying is by permission of the Association for Computing Machinery. To ... 3.2 Control Data CorporatJon ...... conditions, cloud cover present in one im-

computational abilities
quential memory also emergent properties and collective in origin? This paperexamines a .... rons like a conventional digital computer. There is no evidence.

Computational Economics
of applications in labor search, inequality and business cycles to illustrate the practical use ... Method (hours per week): Lecture (2) + practical class (1).

pdf-1595\embedded-computer-vision-advances-in-computer-vision ...
... apps below to open or edit this item. pdf-1595\embedded-computer-vision-advances-in-comput ... sion-and-pattern-recognition-from-brand-springer.pdf.

DIGITALEUROPE Vision 2020
Chapter 2: The transformational power of digital technologies: sector and case examples. 50. Chapter 3: ...... operation of major new renewable energy sources.

Robot Vision
data is available in the Internet at. . ..... uses only cheap off-the-shelf cameras to fulfill its tasks. .... Chapter four deals with vision systems.

Statistics Online Computational Resource - CiteSeerX
http://www.stat.ucla.edu/~dinov/courses_students.html www. ... 2 General Expectation Maximization (GEM) Algorithms. ... Application 2 (Pattern Recognition) .

Computational stereoscopic zoom
10, 2012; published online Apr. 3, 2012. .... by computing the gradient of binary occlusion map where occlusion ..... PhD degrees from Korea Advanced Institute.

Computational Developmental Neuroscience
The author is with the Department of Psychological and Brain Sciences, In- diana University, Bloomington, IN 47405 USA ... developmental program that is biologically grounded, highly. “open-ended,” and stochastic. .... frames show 300 ms of activ

COMPUTATIONAL ACCURACY IN DSP IMPLEMENTATION ...
... more logic gates are required to implement floating-point. operations. Page 3 of 13. COMPUTATIONAL ACCURACY IN DSP IMPLEMENTATION NOTES1.pdf.

Computational Molecular Evolution -
Auckland CapeTown DaresSalaam HongKong Karachi. Kuala Lumpur Madrid ...... Cysteine, however, has low rates of exchange with all other amino acids. Second, the ...... fluctuations of the market value of a stock. In the implementation of ...

Vision Statement.pdf
Timeline: The work of the Committee shall not be longer than 12 months from the date of its first. meeting. The Committee will update the Board on a regular ...