{"id":82,"date":"2016-08-07T13:53:12","date_gmt":"2016-08-07T21:53:12","guid":{"rendered":"http:\/\/wonghoi.humgar.com\/blog\/?page_id=82"},"modified":"2017-07-14T23:15:57","modified_gmt":"2017-07-15T07:15:57","slug":"ideas-oversimplified-signals-and-systems-1-introduction","status":"publish","type":"page","link":"https:\/\/wonghoi.humgar.com\/blog\/ideas-oversimplified-signals-and-systems-1-introduction\/","title":{"rendered":"Oversimplified: Signals and Systems (1) &#8211; Introduction"},"content":{"rendered":"<p>Many people see &#8216;(Linear) Signals and Systems&#8217; as a hard course the first time they take it. It&#8217;s true because the materials are presented in the wrong order, so almost everybody did it the hard way the first time.<\/p>\n<p>The materials in the class are taken for granted (i.e. you are supposed to be not just very familiar, but very comfortable with it)\u00a0before you march into communications, control, MRI, audio and image processing. So in order to not hold you up for the motivating applications, pretty much all schools\u00a0choose to teach &#8216;Signals and Systems&#8217;\u00a0early on right after you&#8217;ve taken the very basic &#8216;Linear Circuits 101&#8217;.<\/p>\n<p>In fact &#8216;Linear Circuits 101&#8217; has little to do with preparing you for &#8216;Signals and Systems&#8217;:\u00a0it&#8217;s just a sanity check to see if you can handle basic high school algebra. In\u00a0reality you&#8217;ll\u00a0need way more math to breeze through &#8216;Signals and Systems&#8217;.\u00a0This is the entire source of misery. A few made it and those\u00a0who don&#8217;t will hate it, then\u00a0switch areas.<\/p>\n<p>There are only 2 true hard prerequisites\u00a0(i.e. you have to know them cold) to master Signals and Systems:<\/p>\n<ol>\n<li>Complex number manipulations (no calculus).<\/li>\n<li>Enough linear algebra to be comfortable with\u00a0inner products<\/li>\n<\/ol>\n<p>Calculus (or differential equations**) is not really important here other than the basic\u00a0definitions and simple derivatives (say, used in less than 5% of the time). If you need integration-by-parts for a problem, you are doing it the very long, painful, hard way.<\/p>\n<p>Complex number manipulations are usually taught at the beginning, but many students thought they &#8216;know&#8217; complex numbers and downplayed it. They obviously paid the price as the course progresses.<\/p>\n<p>What&#8217;s really missing in the standard curriculum is linear algebra and inner products. As I&#8217;ll show later in the series, all the transforms you will learn in the class are simply inner products written out explicitly. You can recall all\u00a0the transforms precisely in a split second if you\u00a0know\u00a0inner products.<\/p>\n<p>The beauty of &#8216;Signals and Systems&#8217; is that there are so many ways to interpret the same\u00a0idea. This also means there&#8217;s a good chance that you&#8217;ll get yourself into\u00a0a strenuous path\u00a0if you blindly brute force everything straight from the definition*. The goal of &#8216;<em>Ideas Oversimplified: Signals and Systems<\/em>&#8216; series is to help you see through the smoke and find the easiest ways through intuition, not hard work and long derivations.<\/p>\n<hr \/>\n<p>* I&#8217;m not telling you to downplay the definitions. In fact, they are the most important thing to\u00a0understand first THEN\u00a0remember (NOT\u00a0the other way round). There are &#8216;gotcha&#8217; problems which the answer came straight off the definition that makes you look stupid once they tell you the answer. More on that later.<\/p>\n<p>** Actually, one of the main punchlines of this class is that you are solving linear constant coefficient differential\/difference equations (LCCDE) the hard way in differential equations class. Linear systems is basically a shorthand for LCCDE and all the tools you learn (convolution and transformation) are manipulating differential\/difference equations under the hood. See Heaviside Operator Theory if you are interested.<\/p>\n<div class=\"pvc_clear\"><\/div>\n<p id=\"pvc_stats_82\" class=\"pvc_stats all  \" data-element-id=\"82\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p>\n<div class=\"pvc_clear\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Many people see &#8216;(Linear) Signals and Systems&#8217; as a hard course the first time they take it. It&#8217;s true because the materials are presented in the wrong order, so almost everybody did it the hard way the first time. The &hellip; <a href=\"https:\/\/wonghoi.humgar.com\/blog\/ideas-oversimplified-signals-and-systems-1-introduction\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n<div class=\"pvc_clear\"><\/div>\n<p id=\"pvc_stats_82\" class=\"pvc_stats all  \" data-element-id=\"82\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p>\n<div class=\"pvc_clear\"><\/div>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"inline_featured_image":false,"footnotes":""},"class_list":["post-82","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages\/82","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/comments?post=82"}],"version-history":[{"count":11,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages\/82\/revisions"}],"predecessor-version":[{"id":560,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages\/82\/revisions\/560"}],"wp:attachment":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/media?parent=82"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}