Modern Stochastics: Theory and Applications logo


  • Help
Login Register

  1. Home
  2. Issues
  3. Volume 11, Issue 2 (2024)
  4. Asymptotic normality of the LSE for chir ...

Asymptotic normality of the LSE for chirp signal parameters
Volume 11, Issue 2 (2024), pp. 195–216
Alexander Ivanov ORCID icon link to view author Alexander Ivanov details   Viktor Hladun ORCID icon link to view author Viktor Hladun details  

Authors

 
Placeholder
https://doi.org/10.15559/24-VMSTA247
Pub. online: 23 January 2024      Type: Research Article      Open accessOpen Access

Received
17 October 2023
Revised
13 January 2024
Accepted
13 January 2024
Published
23 January 2024

Abstract

A time continuous statistical model of chirp signal observed against the background of stationary Gaussian noise is considered in the paper. Asymptotic normality of the LSE for parameters of such a sinusoidal regression model is obtained.

1 Introduction

In signal processing theory and nonlinear regression analysis the problem of detecting hidden periodicities, in particular, the problem of estimation of amplitudes and angular frequencies of the harmonic oscillations in the presence of random noise is intensively studied due to its wide application in various fields of knowledge. The solution to the problem of detecting hidden periodicities has a long history dating back to the works by Lagrange and, since the end of 19th century, there are numerous publications. Not being able to talk here about this subject in more detail, we will refer only to the works [2, 9, 26, 14, 15], where a lot of links to publications on the topic can be found.
Over the past decades, in the literature on signal and image processing sinusoidal statistical models on the plane have been intensively studied due to their multiple applications in the analysis of the symmetrical textured surfaces. See, for example, [27, 16, 28, 17, 25, 12, 11]. Some of scalar and 2D results are generalized to trigonometric regression models on ${\mathbb{R}^{M}}$, $M\ge 3$, in the papers [3, 13, 10].
One more important extension of classical trigonometric models are models of frequency-modulated sinusoidal signals observed in the presence of additive random noises. Different problems of parametric estimation of such signals have been studied for a long time [4, 5]. Now the number of publications in this area has increased significantly. Some links to recent articles can be found in [8].
The most studied is the case of chirp signals, that is, linearly frequency-modulated signals. For continuous time t it can be written as the sum of functions of the form
(1)
\[ A\cos \big(\phi t+\psi {t^{2}}\big)+B\sin \big(\phi t+\psi {t^{2}}\big),\hspace{1em}t\ge 0,\]
where A and B are amplitudes, ϕ is the starting frequency, ψ is the chirp rate. For discrete time t and random noise, that is, for a linear time series, some results on consistency and asymptotic normality of LSE of chirp signal parameters have been obtained in many works. We will only point to publications [23, 18, 20, 21, 24, 19, 7] and references there in.
In the present paper we consider time continuous multiple chirp-signal observed with additive strongly or weakly dependent random noise and obtain a result on the LSE asymptotic normality.
Introduce the notation ${\sin _{j}^{0}}(t)=\sin ({\phi _{j}^{0}}t+{\psi _{j}^{0}}{t^{2}})$, ${\cos _{j}^{0}}(t)=\cos ({\phi _{j}^{0}}t+{\psi _{j}^{0}}{t^{2}})$, ${({C_{j}^{0}})^{2}}={({A_{j}^{0}})^{2}}+{({B_{j}^{0}})^{2}}$. For vectors v and matrices M, we will denote by ${v^{\ast }}$ and ${M^{\ast }}$ the transposed ones.
Assume we observe a stochastic process
(2)
\[ X(t)=g\big(t,{\theta ^{0}}\big)+\varepsilon (t),\hspace{1em}t\in {\mathbb{R}_{+}},\]
where
(3)
\[ g\big(t,{\theta ^{0}}\big)={\sum \limits_{j=1}^{N}}\big({A_{j}^{0}}{\cos _{j}^{0}}(t)+{B_{j}^{0}}{\sin _{j}^{0}}(t)\big),\]
(4)
\[ {\theta ^{0}}={\big({A_{1}^{0}},{B_{1}^{0}},{\phi _{1}^{0}},{\psi _{1}^{0}},\dots ,{A_{N}^{0}},{B_{N}^{0}},{\phi _{N}^{0}},{\psi _{N}^{0}}\big)^{\ast }},\]
$\varepsilon =\{\varepsilon (t),t\in \mathbb{R}\}$ is a stochastic process defined on a probability space $(\Omega ,\mathcal{F},P)$ and satisfying the following condition.
A1. ε is a sample-continuous stationary Gaussian process with zero mean and covariance function (c.f.) $B(t)=E\varepsilon (t)\varepsilon (0)$, $t\in \mathbb{R}$, having one of the properties:
  • (i) $B(t)=L(|t|)|t{|^{-\alpha }}$, $\alpha \in (0,1)$, with nondecreasing slowly varying at infinity function L;
  • (ii) $B(\cdot )\in {L_{1}}(\mathbb{R})$.
In the paper [8] to estimate the parameters (4) we introduced special parametric sets that depend on the observation time T, which allows us to distinguish asymptotically the parameters of our statistical model. Assuming that true values of amplitudes ${A_{j}^{0}},{B_{j}^{0}}\ne 0$, $j=\overline{1,N}$, are different numbers and the true values of frequencies ${\phi _{j}^{0}}$, $j=\overline{1,N}$, and chirp rates ${\psi _{j}^{0}}$, $j=\overline{1,N}$, are different positive numbers, we arrange the chirp rates ${\psi ^{0}}=({\psi _{1}^{0}},\dots ,{\psi _{N}^{0}})$ in increasing order and suppose that ${\psi ^{0}}\in \Psi (\underline{\psi },\overline{\psi })$, where
\[ \Psi (\underline{\psi },\overline{\psi })=\big\{\psi =({\psi _{1}},\dots ,{\psi _{N}})\in {\mathbb{R}^{N}}:0\le \underline{\psi }\lt {\psi _{1}}\lt \cdots \lt {\psi _{N}}\lt \overline{\psi }\lt +\infty \big\}.\]
In turn, we also introduce the parametric set
\[ \Phi (\underline{\phi },\overline{\phi })=\big\{\phi =({\phi _{1}},\dots ,{\phi _{N}}):0\le \underline{\phi }\lt {\phi _{j}}\lt \overline{\phi }\lt +\infty ,j=\overline{1,N}\big\}\]
such that ${\phi ^{0}}=({\phi _{1}^{0}},\dots ,{\phi _{N}^{0}})\in \Phi (\underline{\phi },\overline{\phi })$.
Consider monotonically nondecreasing family of open sets ${\Psi _{T}}\subset \Psi (\underline{\psi },\overline{\psi })$, $T\gt {T_{0}}\gt 0$, containing vector ${\psi ^{0}}$, such that ${\textstyle\bigcup _{T\gt {T_{0}}}}{\Psi _{T}}=\widetilde{\Psi },{\widetilde{\Psi }^{c}}={\Psi ^{c}}(\underline{\psi },\overline{\psi })$, with the following properties.
  • B. 1) ${\lim \nolimits_{T\to \infty }}{\inf _{\substack{1\le j\le N-1\\ {} \psi \in {\Psi _{T}}}}}{T^{2}}({\psi _{j+1}}-{\psi _{j}})=+\infty $;
  • 2) ${\lim \nolimits_{T\to \infty }}{\inf _{\psi \in {\Psi _{T}}}}{T^{2}}{\psi _{1}}=+\infty $.
Definition 1.
Any random vector
(5)
\[ {\theta _{T}}={({A_{1T}},{B_{1T}},{\phi _{1T}},{\psi _{1T}},\dots ,{A_{NT}},{B_{NT}},{\phi _{NT}},{\psi _{NT}})^{\ast }}\]
such that it is an absolute minimum point of the functional
(6)
\[ {Q_{T}}(\theta )={\int _{0}^{T}}{\big[X(t)-g(t,\theta )\big]^{2}}dt\]
on the parametric set ${\Theta _{T}^{c}}\subset {\mathbb{R}^{4N}}$, where amplitudes ${A_{j}}$, ${B_{j}}$, $j=\overline{1,N}$, can take any values and parameters $(\phi ,\psi )$ take values in the set ${\Phi ^{c}}(\underline{\phi },\overline{\phi })\times {\Psi _{T}^{c}}$, $T\gt {T_{0}}\gt 0$, is called LSE of the parameter ${\theta ^{0}}$.
Remark 1.
In the paper [8] integral (6) is preceded by the factor ${T^{-1}}$. In the present paper we keep the same notation ${Q_{T}}(\theta )$.
In [8] we obtained the following result.
Theorem 1.
Let the conditions A1 and B be satisfied. Then LSE ${\theta _{T}}$ is a strongly consistent estimate of parameter ${\theta ^{0}}$ in the sense that ${A_{jT}}\to {A_{j}^{0}}$, ${B_{jT}}\to {B_{j}^{0}}$, $T({\phi _{jT}}-{\phi _{j}^{0}})\to 0$, ${T^{2}}({\psi _{jT}}-{\psi _{j}^{0}})\to 0$ a.s., as $T\to \infty $, $j=\overline{1,N}$.
To formulate the main result of the paper we introduce additional assumptions regarding the stochastic process ε.
  • A2(i) The process ε that satisfies the condition A1(i) has a spectral density $f(\lambda )=\tilde{L}(\frac{1}{|\lambda |})|\lambda {|^{\alpha -1}}$, where $\tilde{L}$ is a slowly varying at infinity function, and f has the 4th spectral moment.
  • (ii) The spectral density of the process ε that satisfies the condition A1(ii) has the 4th spectral moment.
We give an example of the fulfillment of the condition A2(i).
Example 1 (Bessel c.f. [22, 14, 15]).
Let’s consider the process ε with c.f. $B(t)={(1+{t^{2}})^{-\frac{\alpha }{2}}}$, $\alpha \in (0,1)$, $t\in \mathbb{R}$. This function satisfies condition A1(i). Its spectral density is of the form
\[ f(\lambda )=\frac{{2^{\frac{1-\alpha }{2}}}}{\sqrt{\pi }\Gamma (\frac{\alpha }{2})}{K_{\frac{\alpha -1}{2}}}(|\lambda |)|\lambda {|^{\frac{\alpha -1}{2}}},\hspace{1em}\lambda \in \mathbb{R},\]
where ${K_{\nu }}(z),z\gt 0$, is the modified Bessel function of the 2nd kind of order ν. If $\lambda \to 0$, then $f(\lambda )\sim {[2\Gamma (\alpha )\cos \frac{\alpha \pi }{2}]^{-1}}|\lambda {|^{\alpha -1}}(1-h(\lambda ))$, $h(\lambda )\to 0$, as $\lambda \to 0$. For large argument ($\lambda \to +\infty $) ${K_{\frac{\alpha -1}{2}}}\sim \sqrt{\frac{\pi }{2\lambda }}{e^{-\lambda }}$ (see Hankel expansion [1, p. 378, 9.7.2]), that is, $f(\lambda )$ has all the spectral moments.
Theorem 2.
Let the conditions A1, A2 and B be fulfilled. Then the normed LSE
(7)
\[\begin{aligned}{}& {T^{\frac{1}{2}}}{D_{T}}\big({\theta _{T}}-{\theta ^{0}}\big)=\\ {} & =\big(T\big({A_{1T}}-{A_{1}^{0}}\big),T\big({B_{1T}}-{B_{1}^{0}}\big),{T^{2}}\big({\phi _{1T}}-{\phi _{1}^{0}}\big),{T^{3}}\big({\psi _{1T}}-{\psi _{1}^{0}}\big),\dots \\ {} & \dots ,T\big({A_{NT}}-{A_{N}^{0}}\big),T\big({B_{NT}}-{B_{N}^{0}}\big),{T^{2}}\big({\phi _{NT}}-{\phi _{N}^{0}}\big),{T^{3}}\big({\psi _{NT}}-{\psi _{N}^{0}}\big)\big){^{\ast }}\end{aligned}\]
is asymptotically, as $T\to \infty $, normal $N(0,W)$, where W is a block matrix consisting of square blocks (60) of order 4 with elements given by the formulas (59), (61) and (62).
In the 2nd section some auxiliary statements necessary to prove the asymptotic normality of the LSE ${\theta _{T}}$ are obtained.

2 Two lemmas

Set
(8)
\[ \frac{\partial }{\partial {\theta _{i}}}g(t,\theta )={g_{i}}(t,\theta ),\hspace{1em}\frac{{\partial ^{2}}}{\partial {\theta _{i}}\partial {\theta _{j}}}g(t,\theta )={g_{ij}}(t,\theta ),\hspace{1em}i,j=\overline{1,4N},\]
and write down the system of normal equations for ${\theta _{T}}$:
(9)
\[ 0={Q^{\prime }_{T}}({\theta _{T}})={\Bigg(-2{\int _{0}^{T}}\big[X(t)-g(t,{\theta _{T}})\big]{g_{i}}(t,{\theta _{T}})dt\Bigg)_{i=1}^{4N}}.\]
Consider the Hesse matrix
(10)
\[\begin{aligned}{}& {Q^{\prime\prime }_{T}}(\theta )={\Bigg(-2{\int _{0}^{T}}\big[X(t)-g(t,\theta )\big]{g_{ij}}(t,\theta )dt+2{\int _{0}^{T}}{g_{i}}(t,\theta ){g_{j}}(t,\theta )dt\Bigg)_{i,j=1}^{4N}}\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}={Q^{\prime\prime }_{1T}}(\theta )+{Q^{\prime\prime }_{2T}}(\theta ).\end{aligned}\]
and the Taylor expansion
(11)
\[ -\frac{1}{2}{Q^{\prime }_{T}}\big({\theta ^{0}}\big)=\frac{1}{2}{Q^{\prime }_{T}}({\theta _{T}})-\frac{1}{2}{Q^{\prime }_{T}}\big({\theta ^{0}}\big)=\frac{1}{2}{Q^{\prime\prime }_{T}}(\overline{\theta })\big({\theta _{T}}-{\theta ^{0}}\big).\]
Since the Taylor formula for vectors does not exist, equality (11) needs clarification. We write $4N$ Taylor formulas for coordinates of the vector ${Q^{\prime }_{T}}({\theta _{T}})$ and obtain for each such expansion its own intermediate value $\overline{{\theta _{i}}}$ depending on T, which has the property $\| \overline{{\theta _{i}}}-{\theta ^{0}}\| \le \| {\theta _{T}}-{\theta ^{0}}\| $, $i=\overline{1,4N}$. Then, for convenience, we use the notation $\overline{{\theta _{i}}}=\overline{\theta }$, $i=\overline{1,4N}$. It goes without saying, after that ${Q^{\prime\prime }_{T}}(\overline{\theta })$ is no longer a Hesse matrix.
Let’s introduce a block-diagonal matrix ${D_{T}}$ that contains N blocks, and each block, in turn, is the diagonal matrix
(12)
\[ {d_{T}}=\operatorname{diag}\big({T^{1/2}},{T^{1/2}},{T^{3/2}},{T^{5/2}}\big).\]
Then the relation (11) can be rewritten in the form
(13)
\[ {D_{T}}\big({\theta _{T}}-{\theta ^{0}}\big)={\bigg({D_{T}^{-1}}\bigg(\frac{1}{2}{Q^{\prime\prime }_{T}}(\overline{\theta })\bigg){D_{T}^{-1}}\bigg)^{-1}}{D_{T}^{-1}}\bigg(-\frac{1}{2}{Q^{\prime }_{T}}\big({\theta ^{0}}\big)\bigg).\]
Lemma 1.
Under conditions A1 and B
(14)
\[ {D_{T}^{-1}}\bigg(\frac{1}{2}{Q^{\prime\prime }_{T}}(\overline{\theta })\bigg){D_{T}^{-1}}\to H\textit{a.s.,\quad as}\hspace{2.5pt}T\to \infty ,\]
where H is a block-diagonal matrix with blocks
(15)
\[ {H_{m}}=\frac{1}{2}\left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}1& 0& \frac{{B_{m}^{0}}}{2}& \frac{{B_{m}^{0}}}{3}\\ {} 0& 1& -\frac{{A_{m}^{0}}}{2}& -\frac{{A_{m}^{0}}}{3}\\ {} \frac{{B_{m}^{0}}}{2}& -\frac{{A_{m}^{0}}}{2}& \frac{{({C_{m}^{0}})^{2}}}{3}& \frac{{({C_{m}^{0}})^{2}}}{4}\\ {} \frac{{B_{m}^{0}}}{3}& -\frac{{A_{m}^{0}}}{3}& \frac{{({C_{m}^{0}})^{2}}}{4}& \frac{{({C_{m}^{0}})^{2}}}{5}\end{array}\right],\hspace{1em}m=\overline{1,N}.\]
Proof.
Note that
\[ {D_{T}^{-1}}\bigg(\frac{1}{2}{Q^{\prime\prime }_{1T}}(\overline{\theta })\bigg){D_{T}^{-1}}\]
is a block-diagonal matrix and consists of N blocks
(16)
\[\begin{aligned}{}& {d_{T}^{-1}}\bigg(\frac{1}{2}{Q^{\prime\prime }_{1T,k}}(\overline{\theta })\bigg){d_{T}^{-1}}={d_{T}^{-1}}{\Bigg(-{\int _{0}^{T}}\big[X(t)-g(t,\overline{\theta })\big]{g_{ij}}(t,\overline{\theta })dt\Bigg)_{i,j=4k+1}^{4(k+1)}}{d_{T}^{-1}},\\ {} & \hspace{1em}k=\overline{0,N-1}.\end{aligned}\]
Let us show that each matrix (16) converges to zero matrix. Since the proof of this fact is the same for all k, we will carry it out for $k=0$.
Denote the matrix ${d_{T}^{-1}}(\frac{1}{2}{Q^{\prime\prime }_{1T,0}}(\overline{\theta })){d_{T}^{-1}}$ by ${J^{1}}(\overline{\theta })$. Then
(17)
\[\begin{aligned}{}{J^{1}}(\overline{\theta })& ={d_{T}^{-1}}{\Bigg({\int _{0}^{T}}\big[g(t,\overline{\theta })-g\big(t,{\theta ^{0}}\big)\big]{g_{ij}}(t,\overline{\theta })dt\Bigg)_{i,j=1}^{4}}{d_{T}^{-1}}\\ {} & \hspace{1em}-{d_{T}^{-1}}{\Bigg({\int _{0}^{T}}\varepsilon (t){g_{ij}}(t,\overline{\theta })dt\Bigg)_{i,j=1}^{4}}{d_{T}^{-1}}={J_{1}^{1}}+{J_{2}^{1}}.\end{aligned}\]
For further evaluation of matrices ${J_{1}^{1}}$ and ${J_{2}^{1}}$ consider the matrix
(18)
\[\begin{aligned}{}& \hspace{2em}\hspace{2em}{d_{T}^{-1}}{\big({g_{ij}}(t,\overline{\theta })\big)_{i,j=1}^{4}}{d_{T}^{-1}}=\\ {} & \left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}0& 0& \frac{-t{\sin _{1}^{-}}(t)}{{T^{2}}}& \frac{-{t^{2}}{\sin _{1}^{-}}(t)}{{T^{3}}}\\ {} 0& 0& \frac{t{\cos _{1}^{-}}(t)}{{T^{2}}}& \frac{{t^{2}}{\cos _{1}^{-}}(t)}{{T^{3}}}\\ {} \frac{-t{\sin _{1}^{-}}(t)}{{T^{2}}}& \frac{t{\cos _{1}^{-}}(t)}{{T^{2}}}& \frac{-{t^{2}}({\overline{A}_{1}}{\cos _{1}^{-}}(t)+{\overline{B}_{1}}{\sin _{1}^{-}}(t))}{{T^{3}}}& \frac{-{t^{3}}({\overline{A}_{1}}{\cos _{1}^{-}}(t)+{\overline{B}_{1}}{\sin _{1}^{-}}(t))}{{T^{4}}}\\ {} \frac{-{t^{2}}{\sin _{1}^{-}}(t)}{{T^{3}}}& \frac{{t^{2}}{\cos _{1}^{-}}(t)}{{T^{3}}}& \frac{-{t^{3}}({\overline{A}_{1}}{\cos _{1}^{-}}(t)+{\overline{B}_{1}}{\sin _{1}^{-}}(t))}{{T^{4}}}& \frac{-{t^{4}}({\overline{A}_{1}}{\cos _{1}^{-}}(t)+{\overline{B}_{1}}{\sin _{1}^{-}}(t))}{{T^{5}}}\end{array}\right],\end{aligned}\]
where ${\sin _{j}^{-}}(t)=\sin ({\overline{\phi }_{j}}t+{\overline{\psi }_{j}}{t^{2}})$, ${\cos _{j}^{-}}(t)=\cos ({\overline{\phi }_{j}}t+{\overline{\psi }_{j}}{t^{2}})$.
By Theorem 1, for $t\in [0,T]$,
(19)
\[\begin{aligned}{}& \big|g(t,\overline{\theta })-g\big(t,{\theta ^{0}}\big)\big|\le {\sum \limits_{k=1}^{N}}\big(|{\overline{A}_{k}}-{A_{k}^{0}}|+|{\overline{B}_{k}}-{B_{k}^{0}}|\\ {} & +\big(|{A_{k}^{0}}|+|{B_{k}^{0}}|\big)\big(t|{\overline{\phi }_{k}}-{\phi _{k}^{0}}|+{t^{2}}|{\overline{\psi }_{k}}-{\psi _{k}^{0}}|\big)\big)\le {\sum \limits_{k=1}^{N}}\big(|{A_{kT}}-{A_{k}^{0}}|+|{B_{kT}}-{B_{k}^{0}}|\\ {} & +\big(|{A_{k}^{0}}|+|{B_{k}^{0}}|\big)\big(T|{\phi _{kT}}-{\phi _{k}^{0}}|+{T^{2}}|{\psi _{kT}}-{\psi _{k}^{0}}|\big)\big)={\zeta _{T}}\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty .\end{aligned}\]
On the other hand, due to (18), ${J_{1,ij}^{1}}=0$, $i,j=1,2$,
(20)
\[\begin{aligned}{}& {\int _{0}^{T}}\big|{J_{1,13}^{1}}\big|dt\le \frac{{\zeta _{T}}}{2};{\int _{0}^{T}}\big|{J_{1,14}^{1}}\big|dt\le \frac{{\zeta _{T}}}{3};{\int _{0}^{T}}\big|{J_{1,23}^{1}}\big|dt\le \frac{{\zeta _{T}}}{2};{\int _{0}^{T}}\big|{J_{1,24}^{1}}\big|dt\le \frac{{\zeta _{T}}}{3};\\ {} & {\int _{0}^{T}}\big(\big|{J_{1,33}^{1}}\big|+\big|{J_{1,34}^{1}}\big|+\big|{J_{1,44}^{1}}\big|\big)dt\\ {} & \hspace{2em}\hspace{2em}\le \bigg(\frac{1}{3}+\frac{1}{4}+\frac{1}{5}\bigg)\big(|{A_{1T}}-{A_{1}^{0}}|+|{B_{1T}}-{B_{1}^{0}}|+|{A_{1}^{0}}|+|{B_{1}^{0}}|\big){\zeta _{T}}.\end{aligned}\]
So,
(21)
\[ {J_{1}^{1}}\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty .\]
Consider the matrix ${J_{2}^{1}}$ in (17). The elements ${J_{2,ij}^{1}}=0$, $i,j=1,2$. Successively we obtain
(22)
\[\begin{aligned}{}& \big|{J_{2,13}^{1}}\big|=\Bigg|{T^{-2}}{\int _{0}^{T}}\varepsilon (t)t{\sin _{1}^{-}}(t)dt\Bigg|\le \Bigg|{T^{-2}}{\int _{0}^{T}}\varepsilon (t)t\big({\sin _{1}^{-}}(t)-{\sin _{1}^{0}}(t)\big)dt\Bigg|\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}+\Bigg|{T^{-2}}{\int _{0}^{T}}\varepsilon (t)t{\sin _{1}^{0}}(t)dt\Bigg|={I_{1}}(T)+{I_{2}}(T);\end{aligned}\]
\[ {I_{1}}(T)\le {T^{-1}}{\int _{0}^{T}}|\varepsilon (t)|dt\big(T|{\phi _{1T}}-{\phi _{1}^{0}}|+{T^{2}}|{\psi _{1T}}-{\psi _{1}^{0}}|\big),\]
where the 2nd factor vanishes a.s., as $T\to \infty $, and under condition A1
\[ {T^{-1}}{\int _{0}^{T}}|\varepsilon (t)|dt\le \frac{1}{2}\Bigg(1+{T^{-1}}{\int _{0}^{T}}{\varepsilon ^{2}}(t)dt\Bigg)\to \frac{1}{2}\big(1+B(0)\big)\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty ,\]
that is, ${I_{1}}(T)\to 0$ a.s., as $T\to \infty $.
On the other hand, under condition A1(i),
\[\begin{aligned}{}E{I_{2}^{2}}(T)& ={T^{-4}}{\int _{0}^{T}}{\int _{0}^{T}}tsB(t-s){\sin _{1}^{0}}(t){\sin _{1}^{0}}(s)dtds\le {T^{-2}}{\int _{0}^{T}}{\int _{0}^{T}}\hspace{-0.1667em}\hspace{-0.1667em}B(t-s)dtds\\ {} & ={\int _{0}^{1}}{\int _{0}^{1}}B\big(T(t-s)\big)dtds={\int _{-1}^{1}}(1-|t|)B(Tt)dt\le 2{\int _{0}^{1}}B(Tt)dt\\ {} & \le \frac{2}{1-\alpha }\frac{L(T)}{{T^{\alpha }}}.\end{aligned}\]
Let’s take ${T_{n}}={n^{\beta }}$ with $\beta \alpha \gt 1$. Then ${I_{2}}({T_{n}})\to 0$ a.s., as $n\to \infty $. Consider
\[\begin{aligned}{}& \underset{{T_{n}}\le T\le {T_{n+1}}}{\sup }\big|{I_{2}}(T)-{I_{2}}({T_{n}})\big|\le \bigg({\bigg(\frac{{T_{n+1}}}{{T_{n}}}\bigg)^{2}}-1\bigg){I_{2}}({T_{n}})+{I_{3}}({T_{n}}),\\ {} & {I_{3}}({T_{n}})={T_{n}^{-1}}{\int _{{T_{n}}}^{{T_{n+1}}}}|\varepsilon (t)|dt.\end{aligned}\]
As far as
\[ E{I_{3}^{2}}({T_{n}})\le {T_{n}^{-2}}{\int _{{T_{n}}}^{{T_{n+1}}}}{\int _{{T_{n}}}^{{T_{n+1}}}}E|\varepsilon (t)\varepsilon (s)|dtds\le B(0){\bigg(\frac{{T_{n+1}}-{T_{n}}}{{T_{n}}}\bigg)^{2}}=O\big({n^{-2}}\big),\]
then ${I_{3}}({T_{n}})\to 0$ a.s., and ${J_{2,13}^{1}}\to 0$ a.s., as $T\to \infty $.
Similarly, ${J_{2,14}^{1}}$, ${J_{2,23}^{1}}$, ${J_{2,24}^{1}}\to 0$ a.s., as $T\to \infty $.
Under condition A1(ii) the proofs of these facts are almost the same taking into account the relation
\[ {T^{-2}}{\int _{0}^{T}}{\int _{0}^{T}}|B(t-s)|dtds=O\big({T^{-1}}\big).\]
The proof of a.s. convergence of ${J_{2,33}^{1}}$, ${J_{2,34}^{1}}$ and ${J_{2,44}^{1}}$ to zero is the same, and therefore we will prove it for ${J_{2,44}^{1}}$ only:
(23)
\[\begin{aligned}{}& \big|{J_{2,44}^{1}}\big|=\bigg|{T^{-5}}{\int _{0}^{T}}{t^{4}}\varepsilon (t)\big[\big({\overline{A}_{1}}-{A_{1}^{0}}\big){\cos _{1}^{-}}(t)+{A_{1}^{0}}\big({\cos _{1}^{-}}(t)-{\cos _{1}^{0}}(t)\big)\\ {} & \hspace{1em}+{A_{1}^{0}}{\cos _{1}^{0}}(t)+\big({\overline{B}_{1}}-{B_{1}^{0}}\big){\sin _{1}^{-}}(t)+{B_{1}^{0}}\big({\sin _{1}^{-}}(t)-{\sin _{1}^{0}}(t)\big)+{B_{1}^{0}}{\sin _{1}^{0}}(t)\big]dt\bigg|\\ {} & \le \big[|{A_{1T}}-{A_{1}^{0}}|+|{B_{1T}}-{B_{1}^{0}}|+\big(|{A_{1}^{0}}|+|{B_{1}^{0}}|\big)\big(T|{\phi _{1T}}-{\phi _{1}^{0}}|+{T^{2}}|{\psi _{1T}}-{\psi _{1}^{0}}|\big)\big]\\ {} & \hspace{2em}\hspace{1em}\times {T^{-1}}{\int _{0}^{T}}|\varepsilon (t)|dt+\Bigg|{T^{-5}}{\int _{0}^{T}}{t^{4}}\varepsilon (t)\big({A_{1}^{0}}{\cos _{1}^{0}}(t)+{B_{1}^{0}}{\sin _{1}^{0}}(t)\big)dt\Bigg|.\end{aligned}\]
The a.s. convergence to zero of the last integral on the right-hand side of the inequality (23) can be proved similarly to the convergence of ${I_{2}}(T)$. So,
(24)
\[ {D_{T}^{-1}}\bigg(\frac{1}{2}{Q^{\prime\prime }_{1T}}(\overline{\theta })\bigg){D_{T}^{-1}}\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty .\]
Consider next the behavior of the normed matrix (see (10))
(25)
\[ {D_{T}^{-1}}\bigg(\frac{1}{2}{Q^{\prime\prime }_{2T}}(\overline{\theta })\bigg){D_{T}^{-1}}={D_{T}^{-1}}{\Bigg({\int _{0}^{T}}{g_{i}}(t,\overline{\theta }){g_{j}}(t,\overline{\theta })dt\Bigg)_{i,j=1}^{4N}}{D_{T}^{-1}}.\]
Assume first that for fixed ${k_{1}},{k_{2}}\in \overline{0,N-1},{k_{1}}\ne {k_{2}}$, the indices $i=\overline{4{k_{1}}+1,4({k_{1}}+1)}$, $j=\overline{4{k_{2}}+1,4({k_{2}}+1)}$. This means that for some ${m_{1}}\ne {m_{2}}$ we extract in the matrix (25) the 4th order submatrix ${J^{2}}={({J_{lr}^{2}})_{l,r=1}^{4}}$. Then
(26)
\[\begin{aligned}{}& {J_{11}^{2}}={T^{-1}}{\int _{0}^{T}}{\cos _{{m_{1}}}^{-}}(t){\cos _{{m_{2}}}^{-}}(t)dt;\hspace{1em}{J_{12}^{2}}={T^{-1}}{\int _{0}^{T}}{\cos _{{m_{1}}}^{-}}(t){\sin _{{m_{2}}}^{-}}(t)dt;\\ {} & {J_{13}^{2}}={T^{-2}}{\int _{0}^{T}}{\cos _{{m_{1}}}^{-}}(t)\big(-{\overline{A}_{{m_{2}}}}t{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}t{\cos _{{m_{2}}}^{-}}(t)\big)dt;\\ {} & {J_{14}^{2}}={T^{-3}}{\int _{0}^{T}}{\cos _{{m_{1}}}^{-}}(t)\big(-{\overline{A}_{{m_{2}}}}{t^{2}}{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}{t^{2}}{\cos _{{m_{2}}}^{-}}(t)\big)dt;\\ {} & {J_{21}^{2}}={T^{-1}}{\int _{0}^{T}}{\sin _{{m_{1}}}^{-}}(t){\cos _{{m_{2}}}^{-}}(t)dt;\hspace{1em}{J_{22}^{2}}={T^{-1}}{\int _{0}^{T}}{\sin _{{m_{1}}}^{-}}(t){\sin _{{m_{2}}}^{-}}(t)dt;\\ {} & {J_{23}^{2}}={T^{-2}}{\int _{0}^{T}}{\sin _{{m_{1}}}^{-}}(t)\big(-{\overline{A}_{{m_{2}}}}t{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}t{\cos _{{m_{2}}}^{-}}(t)\big)dt;\\ {} & {J_{24}^{2}}={T^{-3}}{\int _{0}^{T}}{\sin _{{m_{1}}}^{-}}(t)\big(-{\overline{A}_{{m_{2}}}}{t^{2}}{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}{t^{2}}{\cos _{{m_{2}}}^{-}}(t)\big)dt;\\ {} & {J_{31}^{2}}={T^{-2}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}t{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}t{\cos _{{m_{1}}}^{-}}(t)\big){\cos _{{m_{2}}}^{-}}(t)dt;\\ {} & {J_{32}^{2}}={T^{-2}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}t{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}t{\cos _{{m_{1}}}^{-}}(t)\big){\sin _{{m_{2}}}^{-}}(t)dt;\\ {} & {J_{33}^{2}}={T^{-3}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}t{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}t{\cos _{{m_{1}}}^{-}}(t)\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}\times \big(-{\overline{A}_{{m_{2}}}}t{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}t{\cos _{{m_{2}}}^{-}}(t)\big)dt;\\ {} & {J_{34}^{2}}={T^{-4}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}t{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}t{\cos _{{m_{1}}}^{-}}(t)\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}\times \big(-{\overline{A}_{{m_{2}}}}{t^{2}}{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}{t^{2}}{\cos _{{m_{2}}}^{-}}(t)\big)dt;\\ {} & {J_{41}^{2}}={T^{-3}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}{t^{2}}{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}{t^{2}}{\cos _{{m_{1}}}^{-}}(t)\big){\cos _{{m_{2}}}^{-}}(t)dt;\\ {} & {J_{42}^{2}}={T^{-3}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}{t^{2}}{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}{t^{2}}{\cos _{{m_{1}}}^{-}}(t)\big){\sin _{{m_{2}}}^{-}}(t)dt;\\ {} & {J_{43}^{2}}={T^{-4}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}{t^{2}}{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}{t^{2}}{\cos _{{m_{1}}}^{-}}(t)\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}\times \big(-{\overline{A}_{{m_{2}}}}t{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}t{\cos _{{m_{2}}}^{-}}(t)\big)dt;\\ {} & {J_{44}^{2}}={T^{-5}}{\int _{0}^{T}}\big(-{\overline{A}_{{m_{1}}}}{t^{2}}{\sin _{{m_{1}}}^{-}}(t)+{\overline{B}_{{m_{1}}}}{t^{2}}{\cos _{{m_{1}}}^{-}}(t)\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}\times \big(-{\overline{A}_{{m_{2}}}}{t^{2}}{\sin _{{m_{2}}}^{-}}(t)+{\overline{B}_{{m_{2}}}}{t^{2}}{\cos _{{m_{2}}}^{-}}(t)\big)dt.\end{aligned}\]
Let us show that each element (26) of the matrix ${J^{2}}$ converges to zero a.s. Since the proofs for all elements are similar, we will prove this fact for the awkward element ${J_{44}^{2}}$, rewriting it in the form
\[\begin{aligned}{}& {J_{44}^{2}}={T^{-5}}{\int _{0}^{T}}{t^{4}}\big(\big[-\big({\overline{A}_{{m_{1}}}}-{A_{{m_{1}}}^{0}}\big){\sin _{{m_{1}}}^{-}}(t)+\big({\overline{B}_{{m_{1}}}}-{B_{{m_{1}}}^{0}}\big){\cos _{{m_{1}}}^{-}}(t)\big]\\ {} & +\big[-{A_{{m_{1}}}^{0}}{\sin _{{m_{1}}}^{-}}(t)+{B_{{m_{1}}}^{0}}{\cos _{{m_{1}}}^{-}}(t)\big]\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(\big[-\big({\overline{A}_{{m_{2}}}}-{A_{{m_{2}}}^{0}}\big){\sin _{{m_{2}}}^{-}}(t)+\big({\overline{B}_{{m_{2}}}}-{B_{{m_{2}}}^{0}}\big){\cos _{{m_{2}}}^{-}}(t)\big]\\ {} & +\big[-{A_{{m_{2}}}^{0}}{\sin _{{m_{2}}}^{-}}(t)+{B_{{m_{2}}}^{0}}{\cos _{{m_{2}}}^{-}}(t)\big]\big)dt={T^{-5}}{\int _{0}^{T}}{t^{4}}({z_{1}}+{z_{2}})({z_{3}}+{z_{4}})dt.\end{aligned}\]
Then
\[\begin{aligned}{}& {T^{-5}}{\int _{0}^{T}}{t^{4}}|{z_{1}}{z_{3}}|dt\le \frac{1}{5}\big(|{A_{{m_{1}}T}}-{A_{{m_{1}}}^{0}}|+|{B_{{m_{1}}T}}{B_{{m_{1}}}^{0}}|\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(|{A_{{m_{2}}T}}-{A_{{m_{2}}}^{0}}|+|{B_{{m_{2}}T}}-{B_{{m_{2}}}^{0}}|\big)\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty ;\\ {} & {T^{-5}}{\int _{0}^{T}}{t^{4}}|{z_{1}}{z_{4}}|dt\le \frac{1}{5}\big(|{A_{{m_{1}}T}}-{A_{{m_{1}}}^{0}}|+|{B_{{m_{1}}T}}-{B_{{m_{1}}}^{0}}|\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(|{A_{{m_{2}}}^{0}}|+|{B_{{m_{2}}}^{0}}|\big)\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty ;\\ {} & {T^{-5}}{\int _{0}^{T}}{t^{4}}|{z_{2}}{z_{3}}|dt\le \frac{1}{5}\big(|{A_{{m_{2}}T}}-{A_{{m_{2}}}^{0}}|+|{B_{{m_{2}}T}}-{B_{{m_{2}}}^{0}}|\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(|{A_{{m_{1}}}^{0}}|+|{B_{{m_{1}}}^{0}}|\big)\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty ;\end{aligned}\]
Write further
\[\begin{aligned}{}& {T^{-5}}{\int _{0}^{T}}{t^{4}}{z_{2}}{z_{4}}dt=\\ {} & {T^{-5}}{\int _{0}^{T}}{t^{4}}\big(\big[-{A_{{m_{1}}}^{0}}\big({\sin _{{m_{1}}}^{-}}(t)-{\sin _{{m_{1}}}^{0}}(t)\big)+{B_{{m_{1}}}^{0}}\big({\cos _{{m_{1}}}^{-}}(t)-{\cos _{{m_{1}}}^{0}}(t)\big)\big]\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}+\big[-{A_{{m_{1}}}^{0}}{\sin _{{m_{1}}}^{0}}(t)+{B_{{m_{1}}}^{0}}{\cos _{{m_{1}}}^{0}}(t)\big]\big)\\ {} & \times \big(\big[-{A_{{m_{2}}}^{0}}\big({\sin _{{m_{2}}}^{-}}(t)-{\sin _{{m_{2}}}^{0}}(t)\big)+{B_{{m_{2}}}^{0}}\big({\cos _{{m_{2}}}^{-}}(t)-{\cos _{{m_{2}}}^{0}}(t)\big)\big]\\ {} & +\big[-{A_{{m_{2}}}^{0}}{\sin _{{m_{2}}}^{0}}(t)+{B_{{m_{2}}}^{0}}{\cos _{{m_{2}}}^{0}}(t)\big]\big)dt={T^{-5}}{\int _{0}^{T}}{t^{4}}({z_{5}}+{z_{6}})({z_{7}}+{z_{8}})dt;\\ {} & {T^{-5}}{\int _{0}^{T}}{t^{4}}|{z_{5}}{z_{7}}|dt\le \frac{1}{5}\big(T|{\phi _{{m_{1}}T}}-{\phi _{{m_{1}}}^{0}}|+{T^{2}}|{\psi _{{m_{1}}T}}-{\psi _{{m_{1}}}^{0}}|\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(T|{\phi _{{m_{2}}T}}-{\phi _{{m_{2}}}^{0}}|+{T^{2}}|{\psi _{{m_{2}}T}}-{\psi _{{m_{2}}}^{0}}|\big)\big(|{A_{{m_{1}}}^{0}}|+|{B_{{m_{1}}}^{0}}|\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(|{A_{{m_{2}}}^{0}}|+|{B_{{m_{2}}}^{0}}|\big)\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty ;\\ {} & {T^{-5}}{\int _{0}^{T}}{t^{4}}|{z_{5}}{z_{8}}|dt\le \frac{1}{5}\big(|{A_{{m_{1}}}^{0}}|+|{B_{{m_{1}}}^{0}}|\big)\big(|{A_{{m_{2}}}^{0}}|+|{B_{{m_{2}}}^{0}}|\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(T|{\phi _{{m_{1}}T}}-{\phi _{{m_{1}}}^{0}}|+{T^{2}}|{\psi _{{m_{1}}T}}-{\psi _{{m_{1}}}^{0}}|\big)\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty ;\\ {} & {T^{-5}}{\int _{0}^{T}}{t^{4}}|{z_{6}}{z_{7}}|dt\le \frac{1}{5}\big(|{A_{{m_{1}}}^{0}}|+|{B_{{m_{1}}}^{0}}|\big)\big(|{A_{{m_{2}}}^{0}}|+|{B_{{m_{2}}}^{0}}|\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}\times \big(T|{\phi _{{m_{2}}T}}-{\phi _{{m_{2}}}^{0}}|+{T^{2}}|{\psi _{{m_{2}}T}}-{\psi _{{m_{2}}}^{0}}|\big)\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty .\end{aligned}\]
The integral remains
(27)
\[\begin{aligned}{}& {T^{-5}}{\int _{0}^{T}}{t^{4}}|{z_{6}}{z_{8}}|dt={T^{-5}}{\int _{0}^{T}}{t^{4}}\big(-{A_{{m_{1}}}^{0}}{\sin _{{m_{1}}}^{0}}(t)+{B_{{m_{1}}}^{0}}{\cos _{{m_{1}}}^{0}}(t)\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\times \big(-{A_{{m_{2}}}^{0}}{\sin _{{m_{2}}}^{0}}(t)+{B_{{m_{2}}}^{0}}{\cos _{{m_{2}}}^{0}}(t)\big)dt.\end{aligned}\]
Similarly, all the integrals (26) can be represented as a random part that converges to zero a.s. plus the same integral with the true values of the parameters.
As it follows from the formulas 2.655 in the integral tables [6, p. 226], for any $\alpha \in \mathbb{R}$, $\beta \in \mathbb{R}\setminus \{0\}$, $n\in \mathbb{N}$,
(28)
\[ {\int _{0}^{T}}{t^{n}}\begin{array}{c}\cos \\ {} \sin \end{array}\big(\alpha t+\beta {t^{2}}\big)dt=O\big({T^{n-1}}\big),\hspace{2.5pt}\text{as}\hspace{2.5pt}T\to \infty .\]
Taking into account that all the parameters ${\phi _{m}^{0}},{\psi _{m}^{0}},m=\overline{1,N}$, are different, the integral (27) reduces to integrals of the form (28) and is the quantity of order $O({T^{-2}})$, $T\to \infty $. The convergence to zero, as $T\to \infty $, is established similarly for all integrals (26), except for ${J_{ij}^{2}},i,j=1,2$. However the last ones are of order $O({T^{-1}})$, if we substitute in them the true values of the parameters.
It remains to consider in matrix (25) a block-diagonal submatrix with blocks ${({J_{ij}^{2}})_{i,j=4k+1}^{4(k+1)}}$, $k=\overline{0,N-1}$. Let’s look at one such block ${J^{2}}(m)$ that corresponds to the m-th term of the regression function g. The elements of this block can be obtained from formulae (26) taking ${m_{1}}={m_{2}}=m$. As above, using the consistency property of the LSE parameters from Theorem 1, we can reduce the problem of calculating the limit of ${J^{2}}(m)$ by considering the elements of the matrix ${J^{2}}(m)$, where the true values of the parameters are substituted. After that, obtaining the limit matrix ${H_{m}}$ from the formulation of Lemma 1 becomes trivial if (28) is applied.
Let’s explain this with an example:
\[\begin{aligned}{}& {J_{44}^{2}}(m)={T^{-5}}{\int _{0}^{T}}{t^{4}}{\big(-{A_{m}^{0}}{\sin _{m}^{0}}(t)+{B_{m}^{0}}{\cos _{m}^{0}}(t)\big)^{2}}dt\to \frac{{({C_{m}^{0}})^{2}}}{10},\hspace{2.5pt}\text{as}\hspace{2.5pt}T\to \infty ,\end{aligned}\]
and so on. On the other hand,
\[ \left[\begin{array}{c@{\hskip10.0pt}c}{J_{11}^{2}}(m)& {J_{12}^{2}}(m)\\ {} {J_{21}^{2}}(m)& {J_{22}^{2}}(m)\end{array}\right]\to \left[\begin{array}{c@{\hskip10.0pt}c}\frac{1}{2}& 0\\ {} 0& \frac{1}{2}\end{array}\right],\hspace{2.5pt}\text{as}\hspace{2.5pt}T\to \infty ,\]
due to the convergence of the Fresnel integrals.  □
Now we introduce one more block-diagonal matrix ${S_{T}}$ consisting of N similar diagonal blocks,
(29)
\[ {s_{T}}=\operatorname{diag}\big({T^{1/2}},{T^{1/2}},{T^{3/2}},{T^{3/2}}\big).\]
Consider the Gaussian random vector (see equation (13)) ${S_{T}}{D_{T}^{-1}}(-\frac{1}{2}{Q^{\prime }_{T}}({\theta ^{0}}))$, consisting of N Gaussian vectors of dimension 4. We write one of them down omitting in the true values of parameters the index $m\in \{1,\dots ,N\}$:
(30)
\[\begin{aligned}{}{\xi _{T}}& =\Bigg({\int _{0}^{T}}\varepsilon (t){\cos ^{0}}(t)dt,{\int _{0}^{T}}\varepsilon (t){\sin ^{0}}(t)dt,\\ {} & \hspace{2em}{\int _{0}^{T}}\varepsilon (t)t\big(-{A^{0}}{\sin ^{0}}(t)+{B^{0}}{\cos ^{0}}(t)\big)dt,\\ {} & \hspace{2em}\hspace{2.5pt}{T^{-1}}{\int _{0}^{T}}\varepsilon (t){t^{2}}\big(-{A^{0}}{\sin ^{0}}(t)+{B^{0}}{\cos ^{0}}(t)\big)dt\Bigg){^{\ast }}={\big({\xi _{T}^{1}},{\xi _{T}^{2}},{\xi _{T}^{3}},{\xi _{T}^{4}}\big)^{\ast }}.\end{aligned}\]
Denote by ${G_{T}}={({G_{ij,T}})_{i,j=1}^{4}}=E{\xi _{T}}{\xi _{T}^{\ast }}$ the covariance matrix of the vector ${\xi _{T}}$ and study its asymptotic behavior as $T\to \infty $. It is convenient to write further $\sin ({\alpha ^{0}}+{\phi ^{0}}t+{\psi ^{0}}{t^{2}})={\sin ^{0}}(t,{\alpha ^{0}})$, $\cos ({\alpha ^{0}}+{\phi ^{0}}t+{\psi ^{0}}{t^{2}})={\cos ^{0}}(t,{\alpha ^{0}})$, $-{A^{0}}{\sin ^{0}}(t)+{B^{0}}{\cos ^{0}}(t)={C^{0}}{\cos ^{0}}(t,{\alpha ^{0}})$, $\tan {\alpha ^{0}}=\frac{{A^{0}}}{{B^{0}}}$.
Let’s do some preliminary calculations. We will use the notation
(31)
\[\begin{aligned}{}& {\mu _{T}}\big(\lambda ,{\alpha ^{0}}\big)=\left[\begin{array}{c@{\hskip10.0pt}c}{\mu _{11,T}}(\lambda ,{\alpha ^{0}})& {\mu _{12,T}}(\lambda ,{\alpha ^{0}})\\ {} {\mu _{21,T}}(\lambda ,{\alpha ^{0}})& {\mu _{22,T}}(\lambda ,{\alpha ^{0}})\end{array}\right]\\ {} & =\left[\begin{array}{c@{\hskip10.0pt}c}{\textstyle\textstyle\int _{0}^{T}}\cos (\lambda t){\cos ^{0}}(t,{\alpha ^{0}})dt& {\textstyle\textstyle\int _{0}^{T}}\cos (\lambda t){\sin ^{0}}(t,{\alpha ^{0}})dt\\ {} {\textstyle\textstyle\int _{0}^{T}}\sin (\lambda t){\cos ^{0}}(t,{\alpha ^{0}})dt& {\textstyle\textstyle\int _{0}^{T}}\sin (\lambda t){\sin ^{0}}(t,{\alpha ^{0}})dt\end{array}\right].\end{aligned}\]
Extracting the full square under the signs of sine and cosine [8] we get
(32)
\[\begin{aligned}{}& \begin{array}{c}{\mu _{11,T}}(\lambda ,{\alpha ^{0}})\\ {} {\mu _{22,T}}(\lambda ,{\alpha ^{0}})\end{array}=\\ {} & =\frac{1}{2}{\int _{0}^{T}}\cos \big({\alpha ^{0}}+\big({\phi ^{0}}-\lambda \big)t+{\psi ^{0}}{t^{2}}\big)dt\pm \frac{1}{2}{\int _{0}^{T}}\cos \big({\alpha ^{0}}+\big({\phi ^{0}}+\lambda \big)t+{\psi ^{0}}{t^{2}}\big)dt\\ {} & =\frac{1}{2\sqrt{{\psi ^{0}}}}\left[\cos \bigg(\frac{{({\phi ^{0}}-\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}}\cos \big({t^{2}}\big)dt\right.\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\left.+\sin \bigg(\frac{{({\phi ^{0}}-\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}}\sin \big({t^{2}}\big)dt\right]\\ {} & \pm \frac{1}{2\sqrt{{\psi ^{0}}}}\left[\cos \bigg(\frac{{({\phi ^{0}}+\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}}\cos \big({t^{2}}\big)dt\right.\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\left.+\sin \bigg(\frac{{({\phi ^{0}}+\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}}\sin \big({t^{2}}\big)dt\right];\end{aligned}\]
(33)
\[\begin{aligned}{}& \begin{array}{c}{\mu _{12,T}}(\lambda ,{\alpha ^{0}})\\ {} {\mu _{21,T}}(\lambda ,{\alpha ^{0}})\end{array}=\\ {} & =\frac{1}{2}{\int _{0}^{T}}\sin \big({\alpha ^{0}}+\big({\phi ^{0}}+\lambda \big)t+{\psi ^{0}}{t^{2}}\big)dt\pm \frac{1}{2}{\int _{0}^{T}}\sin \big({\alpha ^{0}}+\big({\phi ^{0}}-\lambda \big)t+{\psi ^{0}}{t^{2}}\big)dt\\ {} & =\frac{1}{2\sqrt{{\psi ^{0}}}}\left[\cos \bigg(\frac{{({\phi ^{0}}+\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}}\sin \big({t^{2}}\big)dt\right.\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\left.-\sin \bigg(\frac{{({\phi ^{0}}+\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}+\lambda }{2\sqrt{{\psi ^{0}}}}}}\cos \big({t^{2}}\big)dt\right]\\ {} & \pm \frac{1}{2\sqrt{{\psi ^{0}}}}\left[\cos \bigg(\frac{{({\phi ^{0}}-\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}}\sin \big({t^{2}}\big)dt\right.\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\left.-\sin \bigg(\frac{{({\phi ^{0}}-\lambda )^{2}}}{4{\psi ^{0}}}-{\alpha ^{0}}\bigg){\int _{\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}^{T\sqrt{{\psi ^{0}}}+\frac{{\phi ^{0}}-\lambda }{2\sqrt{{\psi ^{0}}}}}}\cos \big({t^{2}}\big)dt\right].\end{aligned}\]
Denote by $S(x)={\textstyle\int _{0}^{x}}\sin ({t^{2}})dt$, $C(x)={\textstyle\int _{0}^{x}}\cos ({t^{2}})dt$, $x\in \mathbb{R}$, the Fresnel integrals and take ${\gamma _{\pm }}(\lambda )=\frac{{\phi ^{0}}\pm \lambda }{2\sqrt{{\psi ^{0}}}}$. Then
(34)
\[\begin{aligned}{}& \underset{T\to \infty }{\lim }{\mu _{T}}\big(\lambda ,{\alpha ^{0}}\big)=\left[\begin{array}{c@{\hskip10.0pt}c}{\mu _{11}}(\lambda ,{\alpha ^{0}})& {\mu _{12}}(\lambda ,{\alpha ^{0}})\\ {} {\mu _{21}}(\lambda ,{\alpha ^{0}})& {\mu _{22}}(\lambda ,{\alpha ^{0}})\end{array}\right],\\ {} & \begin{array}{c}{\mu _{11}}(\lambda ,{\alpha ^{0}})\\ {} {\mu _{22}}(\lambda ,{\alpha ^{0}})\end{array}=\frac{1}{2\sqrt{{\psi ^{0}}}}\bigg[\cos \big({\gamma _{-}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-C\big({\gamma _{-}}(\lambda )\big)\bigg)\\ {} & +\sin \big({\gamma _{-}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-S\big({\gamma _{-}}(\lambda )\big)\bigg)\pm \cos \big({\gamma _{+}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-C\big({\gamma _{+}}(\lambda )\big)\bigg)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}\pm \sin \big({\gamma _{+}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-S\big({\gamma _{+}}(\lambda )\big)\bigg)\bigg];\end{aligned}\]
(35)
\[\begin{aligned}{}& \begin{array}{c}{\mu _{12}}(\lambda ,{\alpha ^{0}})\\ {} {\mu _{21}}(\lambda ,{\alpha ^{0}})\end{array}=\frac{1}{2\sqrt{{\psi ^{0}}}}\bigg[\cos \big({\gamma _{+}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-S\big({\gamma _{+}}(\lambda )\big)\bigg)\\ {} & -\sin \big({\gamma _{+}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-C\big({\gamma _{+}}(\lambda )\big)\bigg)\pm \cos \big({\gamma _{-}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-S\big({\gamma _{-}}(\lambda )\big)\bigg)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}\mp \sin \big({\gamma _{-}^{2}}(\lambda )-{\alpha ^{0}}\big)\bigg(\sqrt{\frac{\pi }{8}}-C\big({\gamma _{-}}(\lambda )\big)\bigg)\bigg].\end{aligned}\]
From (32), (33) and properties of Fresnel integrals it follows that uniformly in $T,\lambda \ge 0$
(36)
\[ \big|{\mu _{ij,T}}\big(\lambda ,{\alpha ^{0}}\big)\big|\le \frac{4}{\sqrt{{\psi ^{0}}}},\hspace{1em}i,j=1,2.\]
Besides, for any $\Lambda \gt 0$ and $i,j=1,2$,
(37)
\[\begin{aligned}{}& 2\sqrt{{\psi ^{0}}}\underset{\lambda \in [0,\Lambda ]}{\sup }\big|{\mu _{ij,T}}\big(\lambda ,{\alpha ^{0}}\big)-{\mu _{ij}}\big(\lambda ,{\alpha ^{0}}\big)\big|\le \underset{\lambda \in [0,\Lambda ]}{\sup }\Bigg|{\int _{0}^{T\sqrt{{\psi ^{0}}}+{\gamma _{+}}(\lambda )}}\cos \big({t^{2}}\big)dt-\sqrt{\frac{\pi }{8}}\Bigg|\\ {} & +\underset{\lambda \in [0,\Lambda ]}{\sup }\Bigg|{\int _{0}^{T\sqrt{{\psi ^{0}}}+{\gamma _{-}}(\lambda )}}\cos \big({t^{2}}\big)dt-\sqrt{\frac{\pi }{8}}\Bigg|\hspace{-0.1667em}+\hspace{-0.1667em}\underset{\lambda \in [0,\Lambda ]}{\sup }\Bigg|{\int _{0}^{T\sqrt{{\psi ^{0}}}+{\gamma _{+}}(\lambda )}}\sin \big({t^{2}}\big)dt\hspace{-0.1667em}-\hspace{-0.1667em}\sqrt{\frac{\pi }{8}}\Bigg|\\ {} & +\underset{\lambda \in [0,\Lambda ]}{\sup }\Bigg|{\int _{0}^{T\sqrt{{\psi ^{0}}}+{\gamma _{-}}(\lambda )}}\sin \big({t^{2}}\big)dt-\sqrt{\frac{\pi }{8}}\Bigg|\to 0,\hspace{2.5pt}\text{as}\hspace{2.5pt}T\to \infty .\end{aligned}\]
To continue the study of the asymptotic behavior, as $T\to \infty $, of the matrix ${G_{T}}$ under condition A2 we will use the standard formula $B(t)=2{\textstyle\int _{0}^{\infty }}\cos (\lambda t)f(\lambda )d\lambda $. Then from (30) by the Lebesque majorized convergence theorem
(38)
\[\begin{aligned}{}{G_{11,T}}& =2{\int _{0}^{\infty }}f(\lambda ){\int _{0}^{T}}{\int _{0}^{T}}\cos \big(\lambda (t-s)\big){\cos ^{0}}(t){\cos ^{0}}(s)dtdsd\lambda \\ {} & =2{\int _{0}^{\infty }}f(\lambda )\big[{\big({\mu _{11,T}}(\lambda ,0)\big)^{2}}+{\big({\mu _{21,T}}(\lambda ,0)\big)^{2}}\big]d\lambda \\ {} & {\xrightarrow[T\to \infty ]{}}2{\int _{0}^{\infty }}f(\lambda )\big[{\big({\mu _{11}}(\lambda ,0)\big)^{2}}+{\big({\mu _{21}}(\lambda ,0)\big)^{2}}\big]d\lambda ={G_{11}}.\end{aligned}\]
Similarly,
(39)
\[ {G_{22}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\big({\mu _{12}}(\lambda ,0)\big)^{2}}+{\big({\mu _{22}}(\lambda ,0)\big)^{2}}\big]d\lambda ;\]
(40)
\[ {G_{12}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\mu _{11}}(\lambda ,0){\mu _{12}}(\lambda ,0)+{\mu _{22}}(\lambda ,0){\mu _{21}}(\lambda ,0)\big]d\lambda .\]
Bellow we will use the notation ${\gamma ^{0}}=\frac{{({C^{0}})^{2}}}{{({\psi ^{0}})^{2}}}$ and formulae (64), (65) from Appendix.
\[\begin{aligned}{}& {G_{33,T}}=2{\big({C^{0}}\big)^{2}}{\int _{0}^{\infty }}f(\lambda ){\int _{0}^{T}}{\int _{0}^{T}}\cos \big(\lambda (t-s)\big)ts{\cos ^{0}}\big(t,{\alpha ^{0}}\big){\sin ^{0}}\big(s,{\alpha ^{0}}\big)dsdtd\lambda \\ {} & =2{\big({C^{0}}\big)^{2}}{\int _{0}^{\infty }}f(\lambda )\left[{\Bigg({\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg)^{2}}\right.\\ {} & \left.+{\Bigg({\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg)^{2}}\right]d\lambda =\frac{{\gamma ^{0}}}{2}{\int _{0}^{\infty }}f(\lambda )\big[\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\cos (\lambda T)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big){^{2}}\\ {} & +{\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\sin (\lambda T)-{\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)-\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big)^{2}}\big]d\lambda \\ {} & =\frac{{\gamma ^{0}}}{2}{\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\big)^{2}}{\int _{0}^{\infty }}f(\lambda ){\cos ^{2}}(\lambda T)d\lambda \\ {} & -{\gamma ^{0}}{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\hspace{-0.1667em}{\int _{0}^{\infty }}\hspace{-0.1667em}f(\lambda )\big[\sin \big({\alpha ^{0}}\big)+{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)-\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]\cos (\lambda T)d\lambda \\ {} & +\frac{{\gamma ^{0}}}{2}{\int _{0}^{\infty }}f(\lambda ){\big[-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]^{2}}d\lambda \\ {} & +\frac{{\gamma ^{0}}}{2}{\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\big)^{2}}{\int _{0}^{\infty }}f(\lambda ){\sin ^{2}}(\lambda T)d\lambda \\ {} & -{\gamma ^{0}}{\sin ^{0}}\big(T,{\alpha ^{0}}\big){\int _{0}^{\infty }}f(\lambda )\big[{\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]\sin (\lambda T)d\lambda \\ {} & +\frac{{\gamma ^{0}}}{2}{\int _{0}^{\infty }}f(\lambda ){\big[{\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]^{2}}d\lambda .\end{aligned}\]
The 2nd and 5th terms of the last sum tend to zero, as $T\to \infty $, due to the uniform convergence (37) and the well-known property of the Fourier transform of functions from ${L_{1}}$. Besides, the adding of the 1st and 4th terms give the following result:
(41)
\[\begin{aligned}{}& \underset{T\to \infty }{\lim }\bigg({G_{33,T}}-\frac{1}{4}{\gamma ^{0}}B(0){\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\big)^{2}}\bigg)\\ {} & =\frac{{\gamma ^{0}}}{2}{\int _{0}^{\infty }}f(\lambda )\big[{\big(-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big)^{2}}\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}+{\big({\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big)^{2}}\big]d\lambda .\end{aligned}\]
The next elements are
(42)
\[\begin{aligned}{}& {G_{23,T}}=2{C^{0}}{\int _{0}^{\infty }}f(\lambda ){\int _{0}^{T}}{\int _{0}^{T}}\cos \big(\lambda (t-s)\big)t{\cos ^{0}}\big(t,{\alpha ^{0}}\big){\sin ^{0}}(s)dsdtd\lambda \\ {} & =2{C^{0}}{\int _{0}^{\infty }}f(\lambda )\left[{\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt{\int _{0}^{T}}\cos (\lambda t){\sin ^{0}}(t)dt\right.\\ {} & \left.+{\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt{\int _{0}^{T}}\sin (\lambda t){\sin ^{0}}(t)dt\right]d\lambda \\ {} & =\sqrt{{\gamma ^{0}}}{\int _{0}^{\infty }}f(\lambda )\big[\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\cos (\lambda T)-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}+\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{12,T}}(\lambda ,0)\\ {} & +\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\sin (\lambda T)-{\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)-\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{22,T}}(\lambda ,0)\big]d\lambda \\ {} & =\sqrt{{\gamma ^{0}}}{\sin ^{0}}\big(T,{\alpha ^{0}}\big){\int _{0}^{\infty }}f(\lambda ){\mu _{12,T}}(\lambda ,0)\cos (\lambda T)d\lambda \\ {} & +\sqrt{{\gamma ^{0}}}{\int _{0}^{\infty }}f(\lambda )\big[-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]{\mu _{12,T}}(\lambda ,0)d\lambda \\ {} & +\sqrt{{\gamma ^{0}}}{\sin ^{0}}\big(T,{\alpha ^{0}}\big){\int _{0}^{\infty }}f(\lambda ){\mu _{22,T}}(\lambda ,0)\sin (\lambda T)d\lambda \\ {} & -\sqrt{{\gamma ^{0}}}{\int _{0}^{\infty }}f(\lambda )\big[{\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]{\mu _{22,T}}(\lambda ,0)d\lambda \\ {} & {\xrightarrow[T\to \infty ]{}}\sqrt{{\gamma ^{0}}}{\int _{0}^{\infty }}f(\lambda )\big[\big(-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{12}}(\lambda ,0)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}-\big({\phi ^{0}}{\mu _{21}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{22}}(\lambda ,0)\big]d\lambda .\end{aligned}\]
Similarly to (42)
(43)
\[\begin{aligned}{}& \underset{T\to \infty }{\lim }{G_{13,T}}=\sqrt{{\gamma ^{0}}}\hspace{-0.1667em}{\int _{0}^{\infty }}\hspace{-0.1667em}f(\lambda )\big[\big(-\sin \big({\alpha ^{0}}\big)\hspace{-0.1667em}-\hspace{-0.1667em}{\phi ^{0}}{\mu _{11}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{11}}(\lambda ,0)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}-\big({\phi ^{0}}{\mu _{11}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{21}}(\lambda ,0)\big]d\lambda .\end{aligned}\]
To find the last diagonal element, we will use formulae (66), (67) and the results of previous calculation:
(44)
\[\begin{aligned}{}& {G_{44,T}}=\frac{2{({C^{0}})^{2}}}{{T^{2}}}{\int _{0}^{\infty }}\hspace{-0.1667em}f(\lambda )\hspace{-0.1667em}{\int _{0}^{T}}\hspace{-0.1667em}\hspace{-0.1667em}{\int _{0}^{T}}\hspace{-0.1667em}\cos \big(\lambda (t-s)\big){t^{2}}{s^{2}}{\cos ^{0}}\big(t,{\alpha ^{0}}\big){\sin ^{0}}\big(s,{\alpha ^{0}}\big)dsdtd\lambda \\ {} & =\frac{2{({C^{0}})^{2}}}{{T^{2}}}{\int _{0}^{\infty }}f(\lambda )\left[{\Bigg({\int _{0}^{T}}{t^{2}}\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg)^{2}}\right.\\ {} & \left.+{\Bigg({\int _{0}^{T}}{t^{2}}\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg)^{2}}\right]d\lambda \hspace{-0.1667em}=\hspace{-0.1667em}\frac{{\gamma ^{0}}}{2{T^{2}}}{\int _{0}^{\infty }}\hspace{-0.1667em}\hspace{-0.1667em}f(\lambda )\Bigg[\Bigg(T{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\cos (\lambda T)\\ {} & -{\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)-{\phi ^{0}}{\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt+\lambda {\int _{0}^{T}}t\sin (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg){^{2}}\\ {} & +\Bigg(T{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\sin (\lambda T)-{\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)-{\phi ^{0}}{\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\\ {} & -\lambda {\int _{0}^{T}}t\cos (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg){^{2}}\Bigg]d\lambda =\frac{{\gamma ^{0}}}{4}B(0){\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\big)^{2}}+O\big({T^{-1}}\big),\end{aligned}\]
as $T\to \infty $.
On the other hand,
(45)
\[\begin{aligned}{}& {G_{34,T}}=\frac{2{({C^{0}})^{2}}}{T}{\int _{0}^{\infty }}f(\lambda ){\int _{0}^{T}}{\int _{0}^{T}}\cos \big(\lambda (t-s)\big){t^{2}}s{\cos ^{0}}(t,\alpha ){\cos ^{0}}(s,\alpha )dtdsd\lambda \\ {} & =\frac{2{({C^{0}})^{2}}}{T}{\int _{0}^{\infty }}f(\lambda )\left[{\int _{0}^{T}}{t^{2}}\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt{\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\right.\\ {} & \left.+{\int _{0}^{T}}{t^{2}}\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt{\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\right]d\lambda \\ {} & =\frac{{({C^{0}})^{2}}}{{\psi ^{0}}T}{\int _{0}^{\infty }}f(\lambda )\left[{\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg(T{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\cos (\lambda T)\right.\\ {} & -{\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)-{\phi ^{0}}{\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt+\lambda {\int _{0}^{T}}t\sin (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg)\\ {} & +{\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg(T{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\sin (\lambda T)-{\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\\ {} & \left.-{\phi ^{0}}{\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt-\lambda {\int _{0}^{T}}t\cos (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg)\right]d\lambda \\ {} & =\frac{{({C^{0}})^{2}}}{{\psi ^{0}}}{\sin ^{0}}\big(T,{\alpha ^{0}}\big){\int _{0}^{\infty }}f(\lambda )\Bigg[{\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg]\cos (\lambda T)d\lambda \\ {} & +\frac{{({C^{0}})^{2}}}{{\psi ^{0}}}{\sin ^{0}}\big(T,{\alpha ^{0}}\big){\int _{0}^{\infty }}f(\lambda )\Bigg[{\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg]\sin (\lambda T)d\lambda +O\big({T^{-1}}\big)\\ {} & =\frac{{\gamma ^{0}}}{4}B(0){\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\big)^{2}}+O\big({T^{-1}}\big)\\ {} & -\frac{{\gamma ^{0}}}{2}{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\hspace{-0.1667em}{\int _{0}^{\infty }}\hspace{-0.1667em}\hspace{-0.1667em}f(\lambda )\big[\sin \big({\alpha ^{0}}\big)+{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)-\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]\cos (\lambda T)d\lambda \\ {} & -\frac{{\gamma ^{0}}}{2}{\sin ^{0}}\big(T,{\alpha ^{0}}\big){\int _{0}^{\infty }}f(\lambda )\big[{\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big]\sin (\lambda T)d\lambda .\end{aligned}\]
From (45) it follows that
(46)
\[ \underset{T\to \infty }{\lim }\bigg({G_{34,T}}-\frac{{\gamma ^{0}}}{4}B(0){\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\big)^{2}}\bigg)=0.\]
Using the same approach, we get
(47)
\[ {G_{14,T}},{G_{24,T}}{\xrightarrow[T\to \infty ]{}}0.\]
Collecting formulas (34), (35), (38)–(47), we arrive at the following statement.
Lemma 2.
Under conditions A1 and A2
(48)
\[ \underset{T\to \infty }{\lim }({G_{T}}-\tilde{{G_{T}}})=\left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}{G_{11}}& {G_{12}}& {G_{13}}& 0\\ {} {G_{21}}& {G_{22}}& {G_{23}}& 0\\ {} {G_{31}}& {G_{32}}& {G_{33}}& 0\\ {} 0& 0& 0& 0\end{array}\right],\]
where
(49)
\[ {\tilde{G}_{T}}=\frac{{\gamma ^{0}}}{4}B(0){\big({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\big)^{2}}\left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}0& 0& 0& 0\\ {} 0& 0& 0& 0\\ {} 0& 0& 1& 1\\ {} 0& 0& 1& 1\end{array}\right];\]
(50)
\[\begin{aligned}{}& {G_{11}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\big({\mu _{11}}(\lambda ,0)\big)^{2}}+{\big({\mu _{21}}(\lambda ,0)\big)^{2}}\big]d\lambda ;\\ {} & {G_{12}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\mu _{11}}(\lambda ,0){\mu _{12}}(\lambda ,0)+{\mu _{22}}(\lambda ,0){\mu _{21}}(\lambda ,0)\big]d\lambda ;\\ {} & {G_{13}}=\sqrt{{\gamma ^{0}}}{\int _{0}^{\infty }}f(\lambda )\big[\big(-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{21}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{11}}(\lambda ,0)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}-\big({\phi ^{0}}{\mu _{11}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{21}}(\lambda ,0)\big]d\lambda ;\\ {} & {G_{22}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\big({\mu _{12}}(\lambda ,0)\big)^{2}}+{\big({\mu _{22}}(\lambda ,0)\big)^{2}}\big]d\lambda ;\\ {} & {G_{23}}=\sqrt{{\gamma ^{0}}}{\int _{0}^{\infty }}f(\lambda )\big[\big(-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{12}}(\lambda ,0)\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}-\big({\phi ^{0}}{\mu _{21}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12}}\big(\lambda ,{\alpha ^{0}}\big)\big){\mu _{22}}(\lambda ,0)\big]d\lambda ;\\ {} & {G_{33}}=\frac{{\gamma ^{0}}}{2}{\int _{0}^{\infty }}f(\lambda )\big[{\big(\sin \big({\alpha ^{0}}\big)+{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)-\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big)^{2}}\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{1em}+{\big({\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big)^{2}}\big]d\lambda .\end{aligned}\]

3 Proof of Theorem 2

Proof.
Consider the matrices ${H_{m}}$ from the formulation of Lemma 1. Standard calculation shows that $\det {H_{m}}=\frac{{({C_{m}^{0}})^{4}}}{34560}$, and
(51)
\[\begin{aligned}{}& {H_{m}^{-1}}=\frac{2}{{({C_{m}^{0}})^{2}}}\\ {} & \times \left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}{({A_{m}^{0}})^{2}}+9{({B_{m}^{0}})^{2}}& -8{A_{m}^{0}}{B_{m}^{0}}& -36{B_{m}^{0}}& 30{B_{m}^{0}}\\ {} -8{A_{m}^{0}}{B_{m}^{0}}& 9{({A_{m}^{0}})^{2}}+{({B_{m}^{0}})^{2}}& 36{A_{m}^{0}}& -30{A_{m}^{0}}\\ {} -36{B_{m}^{0}}& 36{A_{m}^{0}}& 192& -180\\ {} 30{B_{m}^{0}}& -30{A_{m}^{0}}& -180& 180\end{array}\right],\hspace{1em}m=\overline{1,N}.\end{aligned}\]
Thus, ${H^{-1}}$ is a block-diagonal matrix with blocks (51), and
(52)
\[ {K_{T}}={\bigg({D_{T}^{-1}}\bigg(\frac{1}{2}{Q^{\prime\prime }_{T}}(\overline{\theta })\bigg){D_{T}^{-1}}\bigg)^{-1}}-{H^{-1}}\to 0\hspace{2.5pt}\text{a.s.,\quad as}\hspace{2.5pt}T\to \infty .\]
For $\delta \in [0,1)$ rewrite equation (13) in the form
(53)
\[\begin{aligned}{}& {T^{\frac{1}{2}-\delta }}{D_{T}}\big({\theta _{T}}-{\theta ^{0}}\big)={T^{\frac{1}{2}-\delta }}{K_{T}}{S_{T}^{-1}}\bigg({S_{T}}{D_{T}^{-1}}\bigg(-\frac{1}{2}{Q^{\prime }_{T}}\big({\theta ^{0}}\big)\bigg)\bigg)\\ {} & +{T^{\frac{1}{2}-\delta }}{H^{-1}}{S_{T}^{-1}}\bigg({S_{T}}{D_{T}^{-1}}\bigg(-\frac{1}{2}{Q^{\prime }_{T}}\big({\theta ^{0}}\big)\bigg)\bigg).\end{aligned}\]
Add to the notation (30) the subscripts m:
\[\begin{aligned}{}& {\xi _{mT}}={\big({\xi _{mT}^{1}},{\xi _{mT}^{2}},{\xi _{mT}^{3}},{\xi _{mT}^{4}}\big)^{\ast }}=\\ {} & \Bigg({\int _{0}^{T}}\varepsilon (t){\cos _{m}^{0}}(t)dt,{\int _{0}^{T}}\varepsilon (t){\sin _{m}^{0}}(t)dt,{\int _{0}^{T}}\varepsilon (t)t\big(-{A_{m}^{0}}{\sin _{m}^{0}}(t)+{B_{m}^{0}}{\cos _{m}^{0}}(t)\big)dt,\\ {} & {T^{-1}}{\int _{0}^{T}}\varepsilon (t){t^{2}}\big(-{A_{m}^{0}}{\sin _{m}^{0}}(t)+{B_{m}^{0}}{\cos _{m}^{0}}(t)\big)dt\Bigg){^{\ast }},\hspace{1em}m=\overline{1,N};\end{aligned}\]
and put
(54)
\[ {S_{T}}{D_{T}^{-1}}\bigg(-\frac{1}{2}{Q^{\prime }_{T}}\big({\theta ^{0}}\big)\bigg)={\big({\xi _{1T}^{\ast }},\dots ,{\xi _{NT}^{\ast }}\big)^{\ast }}={\Xi _{T}}.\]
Then equation (53) takes the form
(55)
\[\begin{aligned}{}& {T^{\frac{1}{2}-\delta }}{D_{T}}\big({\theta _{T}}-{\theta ^{0}}\big)={T^{\frac{1}{2}-\delta }}{K_{T}}{S_{T}^{-1}}{\Xi _{T}}+{T^{\frac{1}{2}-\delta }}{H^{-1}}{S_{T}^{-1}}{\Xi _{T}}={V_{1T}}(\delta )+{V_{2T}}(\delta ).\end{aligned}\]
Rewrite equation (55) by setting $\delta =0$:
(56)
\[ {T^{\frac{1}{2}}}{D_{T}}\big({\theta _{T}}-{\theta ^{0}}\big)={T^{\frac{1}{2}}}{K_{T}}{S_{T}^{-1}}{\Xi _{T}}+{T^{\frac{1}{2}}}{H^{-1}}{S_{T}^{-1}}{\Xi _{T}}={V_{1T}}(0)+{V_{2T}}(0).\]
Obviously, each element of the matrix ${K_{T}}$ is a stochastic process depending on the parameter T and converging to zero a.s., as $T\to \infty $. Thus each coordinate of the vector ${V_{1T}}(0)$ is a linear combination of elements of the matrix ${K_{T}}$ and one of the stochastic processes ${\xi _{mT}^{1}}$, ${\xi _{mT}^{2}}$, ${T^{-1}}{\xi _{mT}^{3}}$, ${T^{-1}}{\xi _{mT}^{4}}$, $m=\overline{1,N}$. The processes ${\xi _{mT}^{1}}$, ${\xi _{mT}^{2}}$ by Lemma 2 converge weakly to Gaussian random variables with zero mean and variances ${G_{11}}$, ${G_{22}}$ (see formulae (50)), which depend on the parameters $({A_{m}^{0}},{B_{m}^{0}},{\phi _{m}^{0}},{\psi _{m}^{0}})$. Besides, ${T^{-1}}{\xi _{mT}^{3}}$, ${T^{-1}}{\xi _{mT}^{4}}$ converge in mean square to 0, that is, coordinates of the vector ${V_{1T}}(0)$ tend to 0, at least, in probability, as $T\to \infty $.
On the other hand, as follows from (51), the vector ${V_{2T}}(0)={({({V_{2T}^{1}}(0))^{\ast }},\dots ,{({V_{2T}^{N}}(0))^{\ast }})^{\ast }}$, where for $m=\overline{1,N}$
(57)
\[ {V_{2T}^{m}}(0)={H_{m}^{-1}}\left[\begin{array}{c}{\xi _{mT}^{1}}\\ {} {\xi _{mT}^{2}}\\ {} {T^{-1}}{\xi _{mT}^{3}}\\ {} {T^{-1}}{\xi _{mT}^{4}}\end{array}\right].\]
The 3rd and the 4th terms in each row of (57) converge in mean square to zero, and therefore vector ${V_{2T}}(0)$ weakly converges to the Gaussian vector ${V_{2}}(0)={({({V_{2}^{1}}(0))^{\ast }},\dots ,{({V_{2}^{N}}(0))^{\ast }})^{\ast }}$, as $T\to \infty $, with
(58)
\[ {V_{2}^{m}}(0)=\frac{2}{{({C_{m}^{0}})^{2}}}\left[\begin{array}{c}({({A_{m}^{0}})^{2}}+9{({B_{m}^{0}})^{2}}){\xi _{m}^{1}}-8{A_{m}^{0}}{B_{m}^{0}}{\xi _{m}^{2}}\\ {} -8{A_{m}^{0}}{B_{m}^{0}}{\xi _{m}^{1}}+(9{({A_{m}^{0}})^{2}}+{({B_{m}^{0}})^{2}}){\xi _{m}^{2}}\\ {} -36{B_{m}^{0}}{\xi _{m}^{1}}+36{A_{m}^{0}}{\xi _{m}^{2}}\\ {} 30{B_{m}^{0}}{\xi _{m}^{1}}-30{A_{m}^{0}}{\xi _{m}^{2}}\end{array}\right],\hspace{1em}m=\overline{1,N}.\]
Introduce the matrices of order $4\times 2$
(59)
\[ {R_{m}}=\frac{2}{{({C_{m}^{0}})^{2}}}\left[\begin{array}{c@{\hskip10.0pt}c}{({A_{m}^{0}})^{2}}+9{({B_{m}^{0}})^{2}}& -8{A_{m}^{0}}{B_{m}^{0}}\\ {} -8{A_{m}^{0}}{B_{m}^{0}}& 9{({A_{m}^{0}})^{2}}+{({B_{m}^{0}})^{2}}\\ {} -36{B_{m}^{0}}& 36{A_{m}^{0}}\\ {} 30{B_{m}^{0}}& -30{A_{m}^{0}}\end{array}\right],\hspace{1em}m=\overline{1,N},\]
and the random vectors ${r_{m}}={({\xi _{m}^{1}},{\xi _{m}^{2}})^{\ast }}$, $m=\overline{1,N}$, with the covariance matrices ${R_{lm}}=E{r_{l}}{r_{m}^{\ast }}$, $l,m=\overline{1,N}$.
Then the covariance matrix $\Sigma =E{V_{2}}(0){({V_{2}}(0))^{\ast }}$ can be presented in the form of block matrix with square blocks of order 4:
(60)
\[ \Sigma ={\big({R_{l}}{R_{lm}}{R_{m}^{\ast }}\big)_{l,m=1}^{N}}.\]
The elements of the matrices ${R_{lm}}$ are of the form
(61)
\[ {R_{lm}}=\left[\begin{array}{c@{\hskip10.0pt}c}E{\xi _{l}^{1}}{\xi _{m}^{1}}& E{\xi _{l}^{1}}{\xi _{m}^{2}}\\ {} E{\xi _{l}^{2}}{\xi _{m}^{1}}& E{\xi _{l}^{2}}{\xi _{m}^{2}}\end{array}\right],\]
where
(62)
\[ \begin{aligned}{}& E{\xi _{l}^{1}}{\xi _{m}^{1}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\mu _{11,l}}(\lambda ,0){\mu _{11,m}}(\lambda ,0)+{\mu _{21,l}}(\lambda ,0){\mu _{21,m}}(\lambda ,0)\big]d\lambda ;\\ {} & E{\xi _{l}^{1}}{\xi _{m}^{2}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\mu _{11,l}}(\lambda ,0){\mu _{12,m}}(\lambda ,0)+{\mu _{21,l}}(\lambda ,0){\mu _{22,m}}(\lambda ,0)\big]d\lambda ;\\ {} & E{\xi _{l}^{2}}{\xi _{m}^{1}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\mu _{11,m}}(\lambda ,0){\mu _{12,l}}(\lambda ,0)+{\mu _{21,m}}(\lambda ,0){\mu _{22,l}}(\lambda ,0)\big]d\lambda ;\\ {} & E{\xi _{l}^{2}}{\xi _{m}^{2}}=2{\int _{0}^{\infty }}f(\lambda )\big[{\mu _{12,l}}(\lambda ,0){\mu _{12,m}}(\lambda ,0)+{\mu _{22,l}}(\lambda ,0){\mu _{22,m}}(\lambda ,0)\big]d\lambda ;\end{aligned}\]
${\mu _{ij,m}}(\lambda ,0)$, $i,j=1,2$, $m=\overline{1,N}$, are given by formulae (34), (35) by adding the subscripts m corresponding to the parameters $({\phi _{m}^{0}},{\psi _{m}^{0}})$.
Suppose $l=m$, then $E{({\xi _{m}^{1}})^{2}}={G_{11,m}}$, $E{\xi _{m}^{1}}{\xi _{m}^{2}}={G_{12,m}}$, $E{({\xi _{m}^{2}})^{2}}={G_{22,m}}$, where the last 3 values are given by formulae (38)–(40), and we substitute in them the true parameters values ${\phi _{m}^{0}}$ and ${\psi _{m}^{0}}$.  □
Corollary 1.
Under condition A1, A2 and B for any $\delta \in (0,1)$
\[ {T^{1-\delta }}\big({A_{jT}}-{A_{j}^{0}}\big),{T^{1-\delta }}\big({B_{jT}}-{B_{j}^{0}}\big),{T^{2-\delta }}\big({\phi _{jT}}-{\phi _{j}^{0}}\big),{T^{3-\delta }}\big({\psi _{jT}}-{\psi _{j}^{0}}\big)\xrightarrow{P}0,\]
as $T\to \infty $, $j=\overline{1,N}$.
Corollary 1 follows from Theorem 2 and equation (56).
Note also that the limiting Gaussian distribution in Theorem 2 is singular.
Corollary 2.
If $rank(\mathcal{R})=2N$ (see bellow), then $rank(\Sigma )=2N$.
Proof.
The matrix Σ from (60) can be written as the product of three block matrices as follows:
(63)
\[\begin{aligned}{}& \Sigma =\left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}{R_{1}}& 0& 0& \dots & 0\\ {} 0& {R_{2}}& 0& \dots & 0\\ {} 0& 0& {R_{3}}& \dots & 0\\ {} \dots & \dots & \dots & \dots & \dots \\ {} 0& 0& 0& \dots & {R_{N}}\end{array}\right]\times \left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}{R_{11}}& {R_{12}}& {R_{13}}& \dots & {R_{1N}}\\ {} {R_{21}}& {R_{22}}& {R_{23}}& \dots & {R_{2N}}\\ {} {R_{31}}& {R_{32}}& {R_{33}}& \dots & {R_{3N}}\\ {} \dots & \dots & \dots & \dots & \dots \\ {} {R_{N1}}& {R_{N2}}& {R_{N3}}& \dots & {R_{NN}}\end{array}\right]\\ {} & \hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\hspace{2em}\times \left[\begin{array}{c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c@{\hskip10.0pt}c}{R_{1}^{\ast }}& 0& 0& \dots & 0\\ {} 0& {R_{2}^{\ast }}& 0& \dots & 0\\ {} 0& 0& {R_{3}^{\ast }}& \dots & 0\\ {} \dots & \dots & \dots & \dots & \dots \\ {} 0& 0& 0& \dots & {R_{N}^{\ast }}\end{array}\right]=R\mathcal{R}{R^{\ast }},\end{aligned}\]
where R is of order $4N\times 2N$, $\mathcal{R}$ is the square matrix of order $2N$, ${R^{\ast }}$ is of order $2N\times 4N$. The matrix $\mathcal{R}$ is the covariance matrix of the random vector $\xi ={({\xi _{1}^{1}},{\xi _{1}^{2}},\dots ,{\xi _{m}^{1}},{\xi _{m}^{2}},\dots ,{\xi _{N}^{1}},{\xi _{N}^{2}})^{\ast }}$, and in Corollary 2 we assume that it is not singular. Let’s find the $rank$ of the matrix R.
Consider a square submatrix M of R consisting of all its rows that contain the first two rows of each matrix ${R_{m}},m=\overline{1,N}$. Then
\[ \det M={\prod \limits_{m=1}^{N}}\det \left(\frac{2}{{({C_{m}^{0}})^{2}}}\left[\begin{array}{c@{\hskip10.0pt}c}{({A_{m}^{0}})^{2}}+9{({B_{m}^{0}})^{2}}& -8{A_{m}^{0}}{B_{m}^{0}}\\ {} -8{A_{m}^{0}}{B_{m}^{0}}& 9{({A_{m}^{0}})^{2}}+{({B_{m}^{0}})^{2}}\end{array}\right]\right)={36^{N}}.\]
Thus, $rank(R)=rank({R^{\ast }})=2N$, $rank(R\mathcal{R})=rank(R)=2N$, and $rank(\Sigma )=rank(R\mathcal{R}{R^{\ast }})=rank(R\mathcal{R})=2N$.  □

Appendix Appendix

To find the elements of the matrix G from Lemma 2, we need the following integrals.
(64)
\[\begin{aligned}{}& 1){\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\\ {} & \hspace{1em}=\frac{1}{2{\psi ^{0}}}\big[{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\cos (\lambda T)-\sin \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\big];\\ {} & 2){\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\\ {} & \hspace{1em}=\frac{1}{2{\psi ^{0}}}\big[{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\sin (\lambda T)-{\phi ^{0}}{\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)-\lambda {\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)\big];\\ {} & 3){\int _{0}^{T}}t\cos (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\\ {} & \hspace{1em}=\frac{1}{2{\psi ^{0}}}\big[-{\cos ^{0}}\big(T,{\alpha ^{0}}\big)\cos (\lambda T)+\cos \big({\alpha ^{0}}\big)-{\phi ^{0}}{\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)-\lambda {\mu _{21,T}}\big(\lambda ,{\alpha ^{0}}\big)\big];\\ {} & 4){\int _{0}^{T}}t\sin (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\\ {} & \hspace{1em}=\frac{1}{2{\psi ^{0}}}\big[-{\cos ^{0}}\big(T,{\alpha ^{0}}\big)\sin (\lambda T)-{\phi ^{0}}{\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)+\lambda {\mu _{11,T}}\big(\lambda ,{\alpha ^{0}}\big)\big].\end{aligned}\]
Obviously, integrals 1)–4) are bounded in T by the value
(65)
\[ \frac{1}{2{\psi ^{0}}}\bigg(2+{\phi ^{0}}\frac{4}{\sqrt{{\psi ^{0}}}}+\lambda \frac{4}{\sqrt{{\psi ^{0}}}}\bigg)=\frac{1}{{\psi ^{0}}}+2\frac{{\phi ^{0}}+\lambda }{{({\psi ^{0}})^{\frac{3}{2}}}}.\]
Below we calculate integrals similar to the previous ones, but with factors ${t^{2}}$ instead of t. Consider the function
\[ \rho (x)={\int _{0}^{T}}t\sin (xt){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt,\hspace{1em}x\in \mathbb{R},\]
and the integral
(66)
\[\begin{aligned}{}& 5){\int _{0}^{T}}{t^{2}}\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt={\left.\frac{d\rho (x)}{dx}\right|_{x=\lambda }}=\frac{d}{dx}\Bigg[\frac{1}{2{\psi ^{0}}}\Bigg({\sin ^{0}}\big(T,{\alpha ^{0}}\big)\sin (xT)\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}-{\phi ^{0}}{\int _{0}^{T}}\sin (xt){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt-x{\int _{0}^{T}}\cos (xt){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg)\Bigg]{_{x=\lambda }}\\ {} & =\frac{1}{2{\psi ^{0}}}\Bigg[T{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\cos (\lambda T)-{\mu _{12,T}}\big(\lambda ,{\alpha ^{0}}\big)-{\phi ^{0}}{\int _{0}^{T}}t\cos (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt\\ {} & \hspace{2em}\hspace{2em}\hspace{1em}+\lambda {\int _{0}^{T}}t\sin (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg].\end{aligned}\]
Using the same approach, we get
(67)
\[\begin{aligned}{}& 6){\int _{0}^{T}}{t^{2}}\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt=\frac{1}{2{\psi ^{0}}}\Bigg[T{\sin ^{0}}\big(T,{\alpha ^{0}}\big)\sin (\lambda T)-{\mu _{22,T}}\big(\lambda ,{\alpha ^{0}}\big)\\ {} & \hspace{2em}\hspace{1em}-{\phi ^{0}}{\int _{0}^{T}}t\sin (\lambda t){\cos ^{0}}\big(t,{\alpha ^{0}}\big)dt-\lambda {\int _{0}^{T}}t\cos (\lambda t){\sin ^{0}}\big(t,{\alpha ^{0}}\big)dt\Bigg].\end{aligned}\]

References

[1] 
Abramowitz, M., Stegun, I.: Handbook of Mathematical Functions: With Formulas, Graphs, and Mathematical Tables. Courier Corporation (1965). MR0415956
[2] 
Artis, M., Hoffmann, M., Nachane, D., Toro, J.: The Detection of Hidden Periodicities: A Comparison of Alternative Methods. Economics Working Papers No ECO2004/10, European University Institute, San Domenico, Italy (2004)
[3] 
Brillinger, D.R.: Regression for randomly sampled spatial series: the trigonometric case. J. Appl. Probab. Special Vol. 23A, 275–289 (1986). MR0803178. https://doi.org/10.1017/s0021900200117139
[4] 
Cook, C.E., Bernfeld, M.: Radar Signals: an Introduction to Theory and Applications. Academic Press (1967). https://doi.org/10.1016/B978-0-12-186750-8.X5001-7
[5] 
Cramer, H., Leadbetter, M.R.: Stationary and Related Stochastic Processes. Wiley (1967). MR2108670. https://doi.org/10.2307/2344096
[6] 
Gradshteyn, I.S., Ryzhik, I.M.: Table of Integrals, Series, and Products, 7th edition, 1221 pp. Academic Press (2007). MR0669666
[7] 
Grover, R., Kundu, D., Mitra, A.: Asymptotic properties of least squares estimators and sequential least squares estimators of a chirp-like signal model parameters. Circuits Syst. Signal Process. 40(11), 5421–5465 (2021). MR1388718. https://doi.org/10.1007/s00034-021-01724-7
[8] 
Ivanov, A., Hladun, V.: Consistency of the LSE for chirp signal parameters in the models with strongly and weakly dependent noise. Austrian J. Stat. 52(SI), 107–126 (2023). https://doi.org/10.17713/ajs.v52iSI.1762
[9] 
Ivanov, A.V.: Consistency of the least squares estimator of the amplitudes and angular frequencies of a sum of harmonic oscillations in model with long-range dependence. Theory Probab. Math. Stat. 80, 61–69 (2010). MR2541952. https://doi.org/10.1090/S0094-9000-2010-00794-0
[10] 
Ivanov, A.V., Dykyi, O.V.: Consistency of LSE for the many-dimensional symmetric textured surface parameters. Mod. Stoch. Theory Appl. 10(3) (2023). MR4608188. https://doi.org/10.15559/23-VMSTA225
[11] 
Ivanov, A.V., Lymar, O.V.: The asymptotic normality for the least squares estimator of parameters in a two dimensional sinusoidal model of observations. Theory Probab. Math. Stat. 100, 107–131 (2020). MR3992995. https://doi.org/10.1090/tpms/1100
[12] 
Ivanov, A.V., Malyar, O.V.: Consistency of the least squares estimators of parameters of the texture surface sinusoidal model. Theory Probab. Math. Stat. 97, 73–84 (2018). MR3746000. https://doi.org/10.1090/tpms/1049
[13] 
Ivanov, A.V., Savych, I.M.: On the least squares estimators asymptotic normality of the multivariate symmetric textured surface parameters. Theory Probab. Math. Stat. 105, 151–169 (2021). MR4421369. https://doi.org/10.1090/tpms/1161
[14] 
Ivanov, A.V., Leonenko, N.N., Ruiz-Medina, M.D., Savich, I.N.: Limit theorems for weighted non-linear transformations of Gaussian processes with singular spectra. Ann. Probab. 41(2), 1088–1114 (2013). MR3077537. https://doi.org/10.1214/12-AOP775
[15] 
Ivanov, A.V., Leonenko, N.N., Ruiz-Medina, M.D., Zhurakovsky, B.M.: Estimation of harmonic component in regression with cyclically dependent errors. Statistics 49(1), 156–186 (2015). MR3304373. https://doi.org/10.1080/02331888.2013.864656
[16] 
Kundu, D., Mitra, A.: Asymptotic properties of the least squares estimates of 2-D exponential signals. Multidimens. Syst. Signal Process. 7(2), 135–150 (1996). MR1388718. https://doi.org/10.1007/BF01827810
[17] 
Kundu, D., Nandi, S.: Determination of discrete spectrum in a random fiend. Stat. Neerl. 57(2), 258–283 (2003). MR2028915. https://doi.org/10.1111/1467-9574.00230
[18] 
Kundu, D., Nandi, S.: Parameter estimation of chirp signals in presence of stationary noise. Stat. Sin. 18, 187–202 (2008). MR2384984
[19] 
Kundu, D., Nandi, S.: On chirp and some related signal analysis: a brief review and some new results. Sankhya A 83(2), 844–890 (2021). MR4284584. https://doi.org/10.1007/s13171-021-00242-7
[20] 
Lahiri, A.: Estimators of Parameters of Chirp Signals and Their Properties. Ph.D. Thesis, Indian Institute of Technology, Kanpur, India (2011)
[21] 
Lahiri, A., Kundu, D., Mitra, A.: Estimating the parameters of multiple chirp signals. J. Multivar. Anal. 139, 189–206 (2015). MR3349486. https://doi.org/10.1016/j.jmva.2015.01.019
[22] 
Leonenko, N., Olenko, A.: Tauberian and Abelian theorems for long-range dependent random fields. Methodol. Comput. Appl. Probab. 15, 715–742 (2013). MR3117624. https://doi.org/10.1007/s11009-012-9276-9
[23] 
Nandi, S., Kundu, D.: Asymptotic properties of least squares estimators of the parameters of the chirp signals. Ann. Inst. Stat. Math. 56, 529–544 (2004). MR2095017. https://doi.org/10.1007/BF02530540
[24] 
Nandi, S., Kundu, D.: Statistical Signal Processing: Frequency Estimation, 2nd edition. Springer (2020). MR4211771. https://doi.org/10.1007/978-981-15-6280-8
[25] 
Nandi, S., Kundu, D., Srivastava, R.K.: Noise space decomposition method for two-dimensional sinusoidal model. Comput. Stat. Data Anal. 58, 147–161 (2013). MR2997932. https://doi.org/10.1016/j.csda.2011.03.002
[26] 
Quinn, B.G., Hannan, E.J.: The Estimation and Tracking of Frequency. Cambridge University Press (2012). MR1813156. https://doi.org/10.1017/CBO9780511609602
[27] 
Rao, C.R., Zhao, L.C., Zhou, B.: Maximum likelihood estimation of 2-D superimposed exponential. IEEE Trans. Signal Process. 42, 795–802 (1994). https://doi.org/10.1109/78.298285
[28] 
Zhang, H., Mandrekar, V.: Estimation of hidden frequencies for 2D stationary processes. J. Time Ser. Anal. 22(5), 613–629 (2001). MR1859568. https://doi.org/10.1111/1467-9892.00244
Exit Reading PDF XML


Table of contents
  • 1 Introduction
  • 2 Two lemmas
  • 3 Proof of Theorem 2
  • Appendix Appendix
  • References

Export citation

Copy and paste formatted citation
Placeholder

Download citation in file


Share


RSS

MSTA

MSTA

  • Online ISSN: 2351-6054
  • Print ISSN: 2351-6046
  • Copyright © 2018 VTeX

About

  • About journal
  • Indexed in
  • Editors-in-Chief

For contributors

  • Submit
  • OA Policy
  • Become a Peer-reviewer

Contact us

  • ejournals-vmsta@vtex.lt
  • Mokslininkų 2A
  • LT-08412 Vilnius
  • Lithuania
Powered by PubliMill  •  Privacy policy