Multiplicative noise

In signal processing, the term multiplicative noise refers to an unwanted random signal that gets multiplied into some relevant signal during capture, transmission, or other processing.

Multiplicative noise is a type of signal-dependent noise where the noise amplitude scales with the signal's intensity. Unlike additive noise, which is independent of the signal, multiplicative noise complicates processing due to its dependence on the underlying signal.

An important example is the speckle noise commonly observed in radar imagery. Examples of multiplicative noise affecting digital photographs are proper shadows due to undulations on the surface of the imaged objects, shadows cast by complex objects like foliage and Venetian blinds, dark spots caused by dust in the lens or image sensor, and variations in the gain of individual elements of the image sensor array.^[1]

Multiplicative Noise in Stochastic Differential Equations (SDEs)

In the realm of stochastic differential equations (SDEs), multiplicative noise is used to model systems in which the amplitude of stochastic fluctuations internal to the system depend on the state of said system. One of the most prominent examples of multiplicative noise in SDEs is Geometric Brownian motion (GBM). GBM is widely used in finance to model stock prices, currency exchange rates, and other assets. The Geometric Brownian Motion (GBM) model is widely used in financial mathematics to describe the evolution of asset prices. It assumes that the proportional returns of the asset follow a normal distribution over infinitesimal time intervals. The GBM stochastic differential equation is given by: ${\displaystyle dX_{t}=\mu X_{t}\,dt+\sigma X_{t}\,dW_{t},}$ where:

• ${\displaystyle X_{t}}$ is the asset price at time ${\displaystyle t}$,
• ${\displaystyle \mu }$ is the expected return (drift rate),
• ${\displaystyle \sigma }$ is the volatility of returns,
• ${\displaystyle W_{t}}$ is a standard Brownian motion (Wiener process).

Theorem (Itô's formula). Let ${\displaystyle X_{t}}$ be given by: ${\displaystyle dX_{t}=b(t,\omega )\,dt+\sigma (t,\omega )\,dW_{t}.}$ Let ${\displaystyle f(t,x)}$ be a ${\displaystyle C^{1,2}}$ function (i.e., ${\displaystyle C^{1}}$ in time, ${\displaystyle C^{2}}$ in space). Then the process ${\displaystyle Y_{t}=f(X_{t})}$ satisfies ${\displaystyle df(X_{t})=\left(\partial _{t}f(t,X_{t})+\partial _{x}f(t,X_{t})b(t,\omega )+{\frac {1}{2}}\partial _{x,x}f(t,X_{t})\sigma ^{2}(t,\omega )\right)dt+\partial _{x}f(t,X_{t})\sigma (t,\omega )dW_{t}.}$

Set ${\displaystyle f(t,x)=\log x.}$

Applying Itô's formula to ${\displaystyle Y_{t}=f(t,x)}$, we compute: ${\displaystyle d(\log X_{t})=d(Y_{t})=\left[{\frac {1}{X_{t}}}(\mu X_{t})+{\frac {1}{2}}\left(-{\frac {1}{X_{t}^{2}}}\right)(\sigma ^{2}X_{t}^{2})\right]dt+{\frac {1}{X_{t}}}(\sigma X_{t})dW_{t}.}$

Simplifying each term: ${\displaystyle d(\log X_{t})=d(Y_{t})=\left(\mu -{\frac {1}{2}}\sigma ^{2}\right)dt+\sigma dW_{t}.}$

Integrating in time, we have: ${\displaystyle \log X_{t}=Y_{t}=Y_{0}+\left(\mu -{\frac {1}{2}}\sigma ^{2}\right)t+\sigma W_{t},\quad {\text{where}}\quad Y_{0}=\log X_{0}.}$

Exponentiating both sides gives the solution for ${\displaystyle X_{t}}$: ${\displaystyle X_{t}=\exp(Y_{t})=X_{0}\exp \left(\left(\mu -{\frac {1}{2}}\sigma ^{2}\right)t+\sigma W_{t}\right).}$

The solution to this SDE can be explicitly written as: ${\displaystyle X_{t}=X_{0}\exp \left(\left(\mu -{\frac {1}{2}}\sigma ^{2}\right)t+\sigma W_{t}\right),}$ where ${\displaystyle X_{0}}$ is the initial asset price.

The key properties of the GBM model include:

• Log-normal distribution: For any fixed ${\displaystyle t>0}$, ${\displaystyle X_{t}}$ follows a log-normal distribution.
• Non-negativity: ${\displaystyle X_{t}>0}$ almost surely for all ${\displaystyle t}$, ensuring realistic modeling of asset prices that cannot become negative.
• Multiplicative noise: The random fluctuation term ${\displaystyle \sigma X_{t}\,dW_{t}}$ is proportional to ${\displaystyle X_{t}}$, reflecting the empirical fact that larger asset prices tend to exhibit larger absolute fluctuations.

The GBM model forms the basis for the Black–Scholes model used to derive closed-form solutions for European option pricing.

In financial mathematics, the presence of multiplicative noise reflects the empirical observation that the magnitude of fluctuations in asset prices tends to scale with the asset's value. This property is crucial in the derivation of models such as the Black–Scholes model for option pricing.

The Cox–Ingersoll–Ross (CIR) model is described by the stochastic differential equation: ${\displaystyle dr_{t}=a(b-r_{t})\,dt+\sigma {\sqrt {r_{t}}}\,dW_{t},}$ where:

• ${\displaystyle r_{t}}$ is the short-term interest rate,
• ${\displaystyle a>0}$ is the speed of mean reversion,
• ${\displaystyle b>0}$ is the long-term mean level,
• ${\displaystyle \sigma >0}$ is the volatility parameter,
• ${\displaystyle W_{t}}$ is a standard Brownian motion.

The CIR process does not have a simple closed-form solution in terms of ${\displaystyle r_{t}}$ and ${\displaystyle W_{t}}$. However, its conditional distribution is known: for fixed initial value ${\displaystyle r_{0}}$, the variable ${\displaystyle r_{t}}$ follows a scaled noncentral chi-squared distribution.

For numerical simulation, the Euler–Maruyama method can be applied, discretizing time with step size ${\displaystyle \Delta t}$: ${\displaystyle r_{n+1}=r_{n}+a(b-r_{n})\Delta t+\sigma {\sqrt {r_{n}}}\,\Delta W_{n},}$ where ${\displaystyle \Delta W_{n}}$ are independent normal increments with ${\displaystyle \Delta W_{n}\sim {\mathcal {N}}(0,\Delta t).}$

Because of the square-root diffusion term, care must be taken to ensure ${\displaystyle r_{n}\geq 0}$ during simulation. Several methods are used to address this:

• Full truncation scheme: setting negative values to zero.
• Reflection scheme: reflecting negative values back to positive.
• Semi-explicit scheme:

${\displaystyle r_{n+1}=\left({\sqrt {r_{n}+a(b-r_{n})\Delta t}}+{\frac {\sigma }{2}}\Delta W_{n}\right)^{2},}$ which better preserves positivity and improves numerical stability.

Alternatively, ${\displaystyle r_{t}}$ can be exactly sampled by generating a random variable from the appropriate noncentral chi-squared distribution.

The Heston model is a stochastic volatility model used in mathematical finance to describe the evolution of asset prices and their volatility. It extends the Black–Scholes framework by allowing the volatility to change randomly over time.

The Heston model is defined by the following system of stochastic differential equations: ${\displaystyle {\begin{aligned}dS_{t}&=\mu S_{t}\,dt+{\sqrt {v_{t}}}S_{t}\,dW_{t}^{(1)},\\dv_{t}&=\kappa (\theta -v_{t})\,dt+\xi {\sqrt {v_{t}}}\,dW_{t}^{(2)},\end{aligned}}}$ where:

• ${\displaystyle S_{t}}$ is the asset price at time ${\displaystyle t}$,
• ${\displaystyle v_{t}}$ is the instantaneous variance (i.e., square of volatility),
• ${\displaystyle \mu }$ is the drift rate of the asset,
• ${\displaystyle \kappa }$ is the rate at which ${\displaystyle v_{t}}$ reverts to its long-term mean ${\displaystyle \theta }$,
• ${\displaystyle \xi }$ is the volatility of volatility,
• ${\displaystyle W_{t}^{(1)}}$ and ${\displaystyle W_{t}^{(2)}}$ are standard Brownian motions with correlation ${\displaystyle \rho }$

The key feature of the Heston model is that the volatility ${\displaystyle {\sqrt {v_{t}}}}$ is itself a random process driven by a square-root diffusion (similar to the CIR process). This allows the model to capture important empirical features of financial markets, such as:

• Volatility clustering,
• Leverage effect (via ${\displaystyle \rho <0}$),
• Implied volatility smiles and skews.

The Heston model admits a closed-form solution for European option prices using characteristic functions and Fourier transform methods, which makes it both tractable and flexible for calibration to market data.

General Mathematical Form of Multiplicative Noise

In general, a stochastic differential equation with multiplicative noise can be written as: ${\displaystyle dX_{t}=f(X_{t},t)\,dt+g(X_{t},t)\,dW_{t},}$ where:

• ${\displaystyle f(X_{t},t)}$ is the drift term,
• ${\displaystyle g(X_{t},t)}$ is the diffusion coefficient,
• ${\displaystyle W_{t}}$ is a standard Brownian motion.

When the diffusion coefficient ${\displaystyle g}$ depends explicitly on the state variable ${\displaystyle X_{t}}$, the noise is said to be multiplicative. This contrasts with additive noise, where ${\displaystyle g}$ is independent of ${\displaystyle X_{t}}$. Multiplicative noise introduces complexities in both analytical and numerical treatments of SDEs, including the need to carefully choose between interpretations such as the Itô calculus and the Stratonovich calculus.

In particular, under the Itô interpretation, the presence of state-dependent noise can induce additional drift terms when transforming variables, a phenomenon known as the Itô correction.

References

1. Maria Petrou, Costas Petrou (2010) Image Processing: The Fundamentals. John Wiley & Sons. 818 pages. ISBN 9780470745861