{"id":209,"date":"2016-08-08T22:08:03","date_gmt":"2016-08-09T06:08:03","guid":{"rendered":"http:\/\/wonghoi.humgar.com\/blog\/?page_id=209"},"modified":"2017-07-14T23:19:01","modified_gmt":"2017-07-15T07:19:01","slug":"oversimplified-signals-and-systems-4-how-to-represent-a-signal","status":"publish","type":"page","link":"https:\/\/wonghoi.humgar.com\/blog\/oversimplified-signals-and-systems-4-how-to-represent-a-signal\/","title":{"rendered":"Oversimplified: Signals and Systems (4) &#8211; How to represent a signal?"},"content":{"rendered":"<\/p>\n<p>A <span style=\"text-decoration: underline;\">system<\/span>\u00a0can be thought of as a function that maps the input to an output. In this class, most of the systems that we are interested in are linear, therefore the functions are linear as well\u00a0so <span style=\"text-decoration: underline;\">superposition<\/span> applies.<\/p>\n<hr \/>\n<p>We haven&#8217;t defined what the inputs are. In fact it&#8217;s arbitrary, but in &#8216;Signals and Systems&#8217; class, we are mostly interested in two kinds of signals (or systems): continuous time and discrete time*.<\/p>\n<p>For continuous time signal,\u00a0its value is\u00a0well defined over ANY\u00a0time point <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-fd9cb27edab3f0a8a249bc80cc9c6ee2_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#116;\" title=\"Rendered by QuickLaTeX.com\" height=\"12\" width=\"6\" style=\"vertical-align: 0px;\"\/> you specify as long as it&#8217;s within the real line. The time can be <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-ce2009a45822333037922ccca0872a55_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#51;\" title=\"Rendered by QuickLaTeX.com\" height=\"12\" width=\"9\" style=\"vertical-align: 0px;\"\/>, <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-afa020aafa8270db0060cda8e0852529_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#50;&#46;&#53;\" title=\"Rendered by QuickLaTeX.com\" height=\"13\" width=\"22\" style=\"vertical-align: 0px;\"\/>, <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-ed7678864de5d2f3ff6739ada3fd00e9_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#92;&#112;&#105;\" title=\"Rendered by QuickLaTeX.com\" height=\"8\" width=\"11\" style=\"vertical-align: 0px;\"\/>, <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-10dc1f23820214bcfe5b194e9c3acf42_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#45;&#92;&#105;&#110;&#102;&#116;&#121;\" title=\"Rendered by QuickLaTeX.com\" height=\"8\" width=\"30\" style=\"vertical-align: 0px;\"\/>, etc.\u00a0Listing the value at every time point is not an option because there are\u00a0<span style=\"text-decoration: underline;\">uncountablely many<\/span>\u00a0of them. So we\u00a0describe continuous signal\u00a0as a parametric function over <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-fd9cb27edab3f0a8a249bc80cc9c6ee2_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#116;\" title=\"Rendered by QuickLaTeX.com\" height=\"12\" width=\"6\" style=\"vertical-align: 0px;\"\/>, e.g. <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-8a117b47fc20b51548663441e47e41a6_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#92;&#115;&#105;&#110;&#40;&#116;&#41;\" title=\"Rendered by QuickLaTeX.com\" height=\"19\" width=\"41\" style=\"vertical-align: -5px;\"\/>.<\/p>\n<p>As for discrete time signal (or time series), you can tell the value for sure ONLY at a\u00a0<span style=\"text-decoration: underline;\">countable<\/span> number of time points.\u00a0Everything in between is up to interpretation, which we will study later when we get to sampling. I didn&#8217;t say these time points have to\u00a0be evenly spaced (<span style=\"text-decoration: underline;\">uniformly sampled<\/span>), but they\u00a0usually are\u00a0in this class.<\/p>\n<p>We can\u00a0define a discrete time signal\u00a0similarly\u00a0using a\u00a0parametric function such\u00a0as <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-d97aa555c1aa8e140b1f5d1926b81c9b_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#92;&#115;&#105;&#110;&#40;&#92;&#112;&#105;&#32;&#107;&#41;\" title=\"Rendered by QuickLaTeX.com\" height=\"19\" width=\"55\" style=\"vertical-align: -5px;\"\/>, where <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-d42bc2203d6f76ad01b27ac9acc0bee1_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#107;\" title=\"Rendered by QuickLaTeX.com\" height=\"12\" width=\"9\" style=\"vertical-align: 0px;\"\/> is the integer time index. But this time, because the number of time points in a discrete time signal is countable, you can choose to build a look-up table (a\u00a0<span style=\"text-decoration: underline;\">vector<\/span>\u00a0of values, such as <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-4fb9d97d6870f909752dcedd30aa7e70_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#91;&#50;&#44;&#32;&#52;&#44;&#32;&#53;&#44;&#32;&#52;&#44;&#32;&#45;&#49;&#93;&#94;&#84;\" title=\"Rendered by QuickLaTeX.com\" height=\"20\" width=\"108\" style=\"vertical-align: -5px;\"\/>) if your signal is non-zero (<a href=\"http:\/\/www.mathwords.com\/n\/nontrivial.htm\"><span style=\"text-decoration: underline;\">non-trivial<\/span><\/a>) over a fixed a finite number of time points (has <span style=\"text-decoration: underline;\"><a href=\"https:\/\/en.wikipedia.org\/wiki\/Support_(mathematics)\">finite support<\/a><\/span>).<\/p>\n<p>In fact, <span style=\"text-decoration: underline;\">vectors<\/span> (aka look-up tables)\u00a0is the representation\u00a0your computer uses to store\u00a0audio recordings: a sound clip has a finite time span and you only need a countable number of\u00a0time points to play it back\u00a0(we&#8217;ll get to that in sampling theory).\u00a0You will learn more about it when we get to Digital Signal Processing (DSP).<\/p>\n<p>Under the concept of vector spaces,\u00a0(parametric) functions and vectors (look-up tables) can be thought of as the same thing. All rules in linear algebra applies, which I will show you later.<\/p>\n<hr \/>\n<p>Traditionally,\u00a0discrete time and continuous time\u00a0systems are clearly separated and taught\u00a0in any order depending on the teacher&#8217;s\u00a0preference. After you mastered the first one, the rest are almost identical with a few changes.<\/p>\n<p>In my opinion, it is organized like a newbie programmer copying-and-pasting code all over the place when she\/he should have refactored it into a reusable function.<\/p>\n<p>&#8216;Ideas Oversimplified&#8217; offers a new approach to learn\u00a0the essence of the\u00a04-transforms {continuous, discrete}x{Fourier, generalized}, in one shot: using\u00a0inner products in\u00a0(linear) vector spaces. More on that later.<\/p>\n<hr \/>\n<p>* Whenever I say &#8216;time&#8217; (<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-fd9cb27edab3f0a8a249bc80cc9c6ee2_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#116;\" title=\"Rendered by QuickLaTeX.com\" height=\"12\" width=\"6\" style=\"vertical-align: 0px;\"\/>), it can be replaced by any parameter,\u00a0such as distance (<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-7e5fbfa0bbbd9f3051cd156a0f1b5e31_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#120;\" title=\"Rendered by QuickLaTeX.com\" height=\"8\" width=\"10\" style=\"vertical-align: 0px;\"\/>). It&#8217;s just a running variable. I chose not to use <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-7e5fbfa0bbbd9f3051cd156a0f1b5e31_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#120;\" title=\"Rendered by QuickLaTeX.com\" height=\"8\" width=\"10\" style=\"vertical-align: 0px;\"\/> other than for intro to\u00a0complex numbers because I want to reserve the alphabet <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-7e5fbfa0bbbd9f3051cd156a0f1b5e31_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#120;\" title=\"Rendered by QuickLaTeX.com\" height=\"8\" width=\"10\" style=\"vertical-align: 0px;\"\/> and <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-38461fc041e953482219abf5d4cce1cb_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#121;\" title=\"Rendered by QuickLaTeX.com\" height=\"12\" width=\"9\" style=\"vertical-align: -4px;\"\/> for input <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-0f4167a87e6ad9b0cb833c2ee6e243bd_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#120;&#40;&#116;&#41;\" title=\"Rendered by QuickLaTeX.com\" height=\"19\" width=\"29\" style=\"vertical-align: -5px;\"\/> and the output <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/ql-cache\/quicklatex.com-15e7ddd9037930fb096ecf8c2f36db02_l3.png\" class=\"ql-img-inline-formula quicklatex-auto-format\" alt=\"&#121;&#40;&#116;&#41;\" title=\"Rendered by QuickLaTeX.com\" height=\"19\" width=\"28\" style=\"vertical-align: -5px;\"\/>.<\/p>\n<div class=\"pvc_clear\"><\/div>\n<p id=\"pvc_stats_209\" class=\"pvc_stats all  \" data-element-id=\"209\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p>\n<div class=\"pvc_clear\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>A system\u00a0can be thought of as a function that maps the input to an output. In this class, most of the systems that we are interested in are linear, therefore the functions are linear as well\u00a0so superposition applies. We haven&#8217;t &hellip; <a href=\"https:\/\/wonghoi.humgar.com\/blog\/oversimplified-signals-and-systems-4-how-to-represent-a-signal\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n<div class=\"pvc_clear\"><\/div>\n<p id=\"pvc_stats_209\" class=\"pvc_stats all  \" data-element-id=\"209\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/wonghoi.humgar.com\/blog\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p>\n<div class=\"pvc_clear\"><\/div>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"inline_featured_image":false,"footnotes":""},"class_list":["post-209","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages\/209","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/comments?post=209"}],"version-history":[{"count":11,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages\/209\/revisions"}],"predecessor-version":[{"id":561,"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/pages\/209\/revisions\/561"}],"wp:attachment":[{"href":"https:\/\/wonghoi.humgar.com\/blog\/wp-json\/wp\/v2\/media?parent=209"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}