{"id":110,"date":"2019-08-04T16:13:51","date_gmt":"2019-08-04T16:13:51","guid":{"rendered":"https:\/\/machinelearningindaba.com\/2017\/?page_id=110"},"modified":"2019-08-14T13:47:11","modified_gmt":"2019-08-14T13:47:11","slug":"background-topics","status":"publish","type":"page","link":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/","title":{"rendered":"Background Topics"},"content":{"rendered":"<p>Deep Learning is a branch of Machine Learning that applies deep neural networks to modelling data such as <strong>language<\/strong> (labelling sentences as having a positive or negative sentiment, finding the main topics in documents, translating between languages), <strong>speech<\/strong> (transcribing speech data to text), and <strong>images<\/strong> (detecting and labelling objects within images). We expect (and indeed we hope!) to attract attendees from a very wide range of backgrounds, e.g., statistics, information engineering, statistical physics, computational neuroscience, econometrics, computational biology, etc. <strong>So if you\u2019re interested, you should apply.<\/strong><\/p>\n<p>The lectures will range from more introductory to more advanced topics, and will cover topics from across machine learning. We will aim throughout to solidify concepts and fill in gaps through discussions, forming study groups, and having practical sessions. If you\u2019ve completed any previous machine learning course (at a university or an online course), you will have covered most of the necessary background concepts.<\/p>\n<p>You should be able to follow most of the lectures if you have a basic knowledge of these topics (we will also offer refreshers on most of these):<\/p>\n<h4>Linear algebra:<\/h4>\n<p>If you know what vectors and matrices are, and you can multiply a matrix with a vector, you\u2019ll be fine. If not, see the following:<\/p>\n<ul>\n<li>\u200b<a href=\"http:\/\/www.deeplearningbook.org\/contents\/linear_algebra.html\" target=\"_blank\" rel=\"noopener noreferrer\">Linear algebra<\/a> (PDF), <em>chapter 2 in Deep Learning, 2016<\/em>.<\/li>\n<\/ul>\n<h4>Basic calculus:<\/h4>\n<p>If you know how to take derivatives of functions, and how to optimise a function in one variable (find its maximum or minimum), you are fine. If you\u2019ve been exposed to working with multiple variables and know about gradients, you\u2019re in excellent shape. If not, brush up by reading:<\/p>\n<ul>\n<li>\u200b<a href=\"http:\/\/www.deeplearningbook.org\/contents\/numerical.html\" target=\"_blank\" rel=\"noopener noreferrer\">Numerical computation<\/a> (PDF), <em>chapter 4 in Deep Learning, 2016<\/em>, or<\/li>\n<li><a href=\"http:\/\/web4.cs.ucl.ac.uk\/staff\/D.Barber\/textbook\/020217.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Background mathematics (PDF)<\/a>, <em>appendix A in Bayesian Reasoning and Machine Learning, 2017<\/em>\u200b<\/li>\n<\/ul>\n<h4>Probability and statistics:<\/h4>\n<p>If you know what random variables are and what expected values are, you should be fine. If you\u2019ve heard of Gaussian\/Normal distributions and Bayes&#8217; Rule then you are in excellent shape! If not, read through:<\/p>\n<ul>\n<li>\u200b<a href=\"http:\/\/web4.cs.ucl.ac.uk\/staff\/D.Barber\/textbook\/020217.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Probabilistic reasoning (PDF)<\/a>, <em>chapter 1 in Bayesian Reasoning and Machine Learning, 2017<\/em> or<\/li>\n<li><a href=\"http:\/\/www.deeplearningbook.org\/contents\/prob.html\" target=\"_blank\" rel=\"noopener noreferrer\">Probability and information theory (PDF)<\/a>, <em>chapter 3 in Deep Learning, 2016<\/em>.<\/li>\n<\/ul>\n<h4>Programming:<\/h4>\n<p>Any programming experience would be helpful, e.g., if you know what variables are and can write if-statements (conditionals) and loops and use functions, you\u2019ll be fine. In particular if you\u2019ve programmed in Python or have done any numerical computing in Matlab or Scipy, you are in excellent shape!\u200b<\/p>\n<p>However, we don\u2019t expect anyone to be experts at any of these topics and we cannot emphasise enough that if you are interested, we would strongly encourage you to apply!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Deep Learning is a branch of Machine Learning that applies deep neural networks to modelling data such as language (labelling sentences as having a positive or negative sentiment, finding the main topics in documents, translating between languages), speech (transcribing speech data to text), and images (detecting and labelling objects within images). We expect (and indeed [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":185,"parent":170,"menu_order":4,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":"","_links_to":"","_links_to_target":""},"class_list":["post-110","page","type-page","status-publish","has-post-thumbnail","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Background Topics - Deep Learning Indaba 2017<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Background Topics - Deep Learning Indaba 2017\" \/>\n<meta property=\"og:description\" content=\"Deep Learning is a branch of Machine Learning that applies deep neural networks to modelling data such as language (labelling sentences as having a positive or negative sentiment, finding the main topics in documents, translating between languages), speech (transcribing speech data to text), and images (detecting and labelling objects within images). We expect (and indeed [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/\" \/>\n<meta property=\"og:site_name\" content=\"Deep Learning Indaba 2017\" \/>\n<meta property=\"article:modified_time\" content=\"2019-08-14T13:47:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/deeplearningindaba.com\/2017\/wp-content\/uploads\/sites\/2\/2019\/08\/wits-science-building.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2048\" \/>\n\t<meta property=\"og:image:height\" content=\"1332\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/\",\"url\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/\",\"name\":\"Background Topics - Deep Learning Indaba 2017\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2019\\\/08\\\/wits-science-building.jpg\",\"datePublished\":\"2019-08-04T16:13:51+00:00\",\"dateModified\":\"2019-08-14T13:47:11+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/#primaryimage\",\"url\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2019\\\/08\\\/wits-science-building.jpg\",\"contentUrl\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2019\\\/08\\\/wits-science-building.jpg\",\"width\":2048,\"height\":1332},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/background-topics\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Indaba\",\"item\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Programme\",\"item\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/indaba\\\/programme\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Background Topics\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/#website\",\"url\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/\",\"name\":\"Deep Learning Indaba 2017\",\"description\":\"Just another Deep Learning Indaba site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/deeplearningindaba.com\\\/2017\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Background Topics - Deep Learning Indaba 2017","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/","og_locale":"en_US","og_type":"article","og_title":"Background Topics - Deep Learning Indaba 2017","og_description":"Deep Learning is a branch of Machine Learning that applies deep neural networks to modelling data such as language (labelling sentences as having a positive or negative sentiment, finding the main topics in documents, translating between languages), speech (transcribing speech data to text), and images (detecting and labelling objects within images). We expect (and indeed [&hellip;]","og_url":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/","og_site_name":"Deep Learning Indaba 2017","article_modified_time":"2019-08-14T13:47:11+00:00","og_image":[{"width":2048,"height":1332,"url":"https:\/\/deeplearningindaba.com\/2017\/wp-content\/uploads\/sites\/2\/2019\/08\/wits-science-building.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/","url":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/","name":"Background Topics - Deep Learning Indaba 2017","isPartOf":{"@id":"https:\/\/deeplearningindaba.com\/2017\/#website"},"primaryImageOfPage":{"@id":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/#primaryimage"},"image":{"@id":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/#primaryimage"},"thumbnailUrl":"https:\/\/deeplearningindaba.com\/2017\/wp-content\/uploads\/sites\/2\/2019\/08\/wits-science-building.jpg","datePublished":"2019-08-04T16:13:51+00:00","dateModified":"2019-08-14T13:47:11+00:00","breadcrumb":{"@id":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/#primaryimage","url":"https:\/\/deeplearningindaba.com\/2017\/wp-content\/uploads\/sites\/2\/2019\/08\/wits-science-building.jpg","contentUrl":"https:\/\/deeplearningindaba.com\/2017\/wp-content\/uploads\/sites\/2\/2019\/08\/wits-science-building.jpg","width":2048,"height":1332},{"@type":"BreadcrumbList","@id":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/background-topics\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/deeplearningindaba.com\/2017\/"},{"@type":"ListItem","position":2,"name":"Indaba","item":"https:\/\/deeplearningindaba.com\/2017\/"},{"@type":"ListItem","position":3,"name":"Programme","item":"https:\/\/deeplearningindaba.com\/2017\/indaba\/programme\/"},{"@type":"ListItem","position":4,"name":"Background Topics"}]},{"@type":"WebSite","@id":"https:\/\/deeplearningindaba.com\/2017\/#website","url":"https:\/\/deeplearningindaba.com\/2017\/","name":"Deep Learning Indaba 2017","description":"Just another Deep Learning Indaba site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/deeplearningindaba.com\/2017\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/pages\/110","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/comments?post=110"}],"version-history":[{"count":2,"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/pages\/110\/revisions"}],"predecessor-version":[{"id":122,"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/pages\/110\/revisions\/122"}],"up":[{"embeddable":true,"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/pages\/170"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/media\/185"}],"wp:attachment":[{"href":"https:\/\/deeplearningindaba.com\/2017\/wp-json\/wp\/v2\/media?parent=110"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}