Signals, LTI Systems, Convolution and Sampling
2. Linear, time-invariant, and why both are needed
Linearity means scaling the input scales the output and adding two inputs adds their outputs. Time-invariance means delaying the input only delays the output, with no change of shape. A system with both is an LTI system, and an LTI system is completely characterised by its impulse response h(t): once h is known, the output for any input is the convolution of the input with h. Neither property alone is enough. A squarer is time-invariant and not linear. An amplifier whose gain drifts with the hour is linear and not time-invariant, and its output shape depends on when you applied the input.
| Property | Condition on h | What it means physically |
|---|---|---|
| Causal | h(t) = 0 for t < 0 | No output before the input arrives |
| BIBO stable | h is absolutely integrable | Every bounded input gives a bounded output |
3. Convolution and correlation: same integral, different question
Convolution flips one signal, slides it across the other, and reports the overlap at every shift. That flip is the whole difference from correlation, which slides without flipping. Convolution answers what a system DOES to a signal; correlation answers how much two signals RESEMBLE each other at a given lag, which is what a radar or an ultrasonic flowmeter in Section 9 is computing when it looks for an echo. For a symmetric signal the two coincide, which is why the distinction is easy to forget and easy to be caught on.
- Convolution is commutative, associative and distributive — so cascaded LTI blocks may be reordered on paper, whatever the wiring says.
- Convolving with an impulse returns the signal unchanged; convolving with a shifted impulse shifts it.
- The length of a convolution of two finite sequences is the sum of their lengths minus one.
4. Sampling, and the frequency that is a lie
Sampling a continuous signal every T seconds makes copies of its spectrum spaced at the sampling frequency. If the signal contains nothing above half the sampling frequency, the copies do not touch and the original can be recovered exactly. If it does, the copies overlap and the parts that fold back arrive disguised as lower frequencies. That is aliasing, and nothing downstream can undo it: once two frequencies have produced identical samples, no filter, no processing and no amount of resolution can tell them apart again.
The practical consequence is the anti-aliasing filter, and it must sit BEFORE the converter. A low-pass filter in the analog path removes what would have folded; the same filter applied after digitising removes a band of the spectrum but leaves the aliased components exactly where they landed, because they are now indistinguishable from real signal at those frequencies.
Key takeaways
- An LTI system is its impulse response — h decides the output for every possible input, by convolution.
- Causality is h(t) = 0 before zero; BIBO stability is h absolutely integrable. Decaying to zero is not enough.
- Convolution flips before sliding, correlation does not — and the two agree only when one signal is symmetric.
- Sample above twice the highest frequency present, and filter before the converter, never after.
- Aliasing is not noise and cannot be removed downstream; it is a wrong frequency that now looks real.
Practice questions (8)
Attempt each one before opening the answer. Every explanation names the tempting wrong option as well as the right one, because that is where marks are lost.
A system is described by y(t) = 3x(t) + 5. Which is true?
Show answer
Answer: B — Time-invariant but not linear
Delaying the input delays the output unchanged, so it is time-invariant. It is not linear: zero input gives an output of 5, and a linear system must map zero to zero. The constant offset is the whole of the failure — calling this linear because the graph is a straight line is the usual slip, and a straight line through 5 is affine rather than linear.The signal x(t) = sin(2t) + sin(3t) is periodic with fundamental period
Show answer
Answer: A — 2*pi
The two components have periods pi and 2pi/3. Their ratio is 3/2, which is rational, so the sum repeats at the least common multiple of the two, namely 2pi. Answering pi takes the larger of the two periods rather than the LCM, and at t = pi the second component has completed one and a half cycles rather than a whole number of them.An LTI system has impulse response h(t) = e^(-2t) for t >= 0 and zero otherwise. The system is
Show answer
Answer: A — causal and BIBO stable
h vanishes for negative time, so no output precedes its input and the system is causal. The integral of the magnitude of h from zero to infinity is one half, which is finite, so it is BIBO stable. The trap is treating exponential decay as sufficient on its own: decay is necessary but the test is finite total area, and 1/(1+t) decays while its integral diverges.A discrete sequence of 7 samples is convolved with a sequence of 4 samples. How many samples does the result have?
Numerical answer — type the value.
Show answer
Answer: 10
The convolution of sequences of lengths M and N has length M + N - 1, so 7 + 4 - 1 = 10. The minus one is there because both sequences contribute a sample at the first overlap position; answering 11 forgets it, and answering 7 confuses convolution with filtering a signal in place, which is what a running average of fixed output length would do.Convolution and correlation of two signals give the same result when
Show answer
Answer: B — one of the signals is an even function
The only difference between the two operations is that convolution reverses one signal before sliding it. Reversing an even function leaves it unchanged, so the two integrals coincide. Causality says nothing about symmetry and equal energy says nothing about shape, so neither forces the reversal to be harmless.A 30 Hz sinusoid is sampled at 50 Hz with no anti-aliasing filter. At what frequency, in Hz, does it appear in the sampled data?
Numerical answer — type the value.
Show answer
Answer: 20
The sampling rate is below twice the signal frequency, so the component folds. It reappears at the distance from 30 Hz to the nearest multiple of the sampling rate, that is 50 - 30 = 20 Hz. Answering 30 assumes the sample rate is adequate when it is not, and answering 25 quotes the Nyquist frequency, which is the boundary rather than where this component lands.Which statements about sampling and aliasing are correct?
Show answer
Answer: A — An anti-aliasing filter must act before the analog-to-digital converter.; B — Aliased components cannot be removed by any later digital processing.; D — A signal with no energy above half the sampling rate can be recovered exactly.
Filtering must precede conversion, because after conversion the folded components sit at frequencies where real signal also lives and are indistinguishable from it; that is also why no later processing removes them. Recovery is exact when nothing exceeds half the sampling rate. Resolution is a separate axis entirely: more bits reduce quantisation error and do nothing whatever about which frequencies folded.Two LTI blocks with impulse responses h1 and h2 are connected in cascade, and the same two are connected in the opposite order. The overall impulse responses are
Show answer
Answer: A — identical, because convolution is commutative
The cascade of two LTI systems has impulse response h1 convolved with h2, and convolution is commutative, so the order on paper makes no difference to the mathematics. Stability and symmetry are irrelevant to the commutation. The loading answer is the physically alert one and is exactly why this is an idealisation: real cascaded stages do load one another, which is why instrumentation amplifiers are buffered, but that effect is outside the LTI block description and is modelled by changing h rather than by reordering it.