1 Introduction

With the advent of 5G communications, the demands for low latency and high data rates significantly increase [13]. Among the technologies that have been proposed to achieve these goals is the millimeter wave (mm-Wave)-based massive antenna array system [4]. It has been shown that massive antenna arrays can improve both link reliability and spectral efficiency of the system. However, as the number of antennas increases, a number of challenging problems comes out and it needs to be considered. Firstly, employing massive number of antennas needs a large number of RF chains, which may lead to both higher energy consumption of system and higher hardware cost and complexity. This is because the RF chains composed of digital to analog (D/A) converters, analog to digital (A/D) converters, amplifiers, and mixers. On the other hand, directly processing the data received from massive number of antennas causes heavy computational load, which may impose a big challenge in practical application.

In order to solve these issues, various methodologies have been suggested. In [5], the authors have proposed using multiple antennas combining architecture to reduce the power consumption. In [6] and [7], the electromagnetic lens-focusing antennas are used to reduce the hardware complexity and accordingly minimize the computational cost. An antenna selection algorithm was proposed in [8] to decrease the number of RF chains. Antenna selection techniques can effectively reduce both the hardware cost as well as the number of RF chains. However, the problem of DoA estimation for lens antenna array (LNA)-based systems has not yet been addressed in the literature. Actually, it is widely believed that estimating the DoAs is a key aspect for future communication systems. In particular, the 5G public-private-partnership automotive vertical white paper has proposed the requirement of highly accurate location [2] for different 5G services. Location information is one of the eight key performance indicatorsFootnote 1 required for different vertical industries like autonomous vehicles, e-health, and media sectors. Therefore, to meet the convergence requirement for 5G industries, accurate estimation of DoA becomes a necessity.

There have been a number of methods for DoA estimation, such as multiple signal classification (MUSIC) [9], maximum likelihood (ML) estimation [10], and so on. However, all these methods require that the spacing of array elements must be not larger than half-wavelength, or it would cause the angle ambiguity problem. Against this background, this paper is the first that proposes the use of LNA for solving the angle ambiguity problem, where we have verified that the receive array response vector of LNA is approximately a sinc function of the DoA, which is an aperiodic function. Although the array structure with LNA can solve the phase ambiguity problem, large antenna arrays require increased signal processing complexity and hardware costs. In order to solve this problem, this paper makes full use of the distribution characteristics of the signal power and proposes maximal power criterion to select the corresponding antenna and two antennas around it. In order to estimate the angle of incidence of the signal, we just need to deal with the data on these three antennas. Specifically, we derive an expression for the received signal from massive LNA and accordingly formulate a ML approach to DoAs estimation for such LNA-based structure. Additionally, we study the use of LNA to avoid the angle ambiguity problem. Finally, we study the use of AS techniques with the LNA structure for reducing the number of RF chains and signal processing complexity.

The remainder of this paper is organized as follows. In Section 2, we derive an expression for the received signal from the LNA structure. In Section 3, we formulate the ML approach to the DoA estimation for the system that based on LNA. In Section 4, we compare the performance of ML method of the LNA structure, to that of the conventional schemes without the LNA. Conclusions are presented in Section 5.

2 Problem formulation

In optics, lens are able to change the direction of the light through refraction phenomena and accordingly focusing the energy of signal in that direction. A LNA is described in Fig. 1. We assume that the width of EM lens is L and its thickness is negligible. The LNA has N elements which are located on the Y-axis. The unit inter-element spacing d is set to λ/2, with λ denoting the signal wavelength. The focal length of the lens is F, and the LNA locations relative to the lens center can be parameterized as Bm (xm=F,ym=F tan(θm),zm=0), where θm∈[−π/2,π/2] is the angle of the mth antenna element relative to the x-axis. The indices of each antenna element is set from −(N−1)/2 to (N−1)/2. Due to the characteristics of the EM lens, the light parallel to the axis will converge to the focus point B0, with the same phase ψ0. We assume that the phase of the signal reaching the lens is ψ(y,z). With constructive superposition [11], we have

$$ \begin{aligned} \psi(y,z)+2 \pi/\lambda d(y,z,B_{0})=\psi_{0} \\ \forall(y,z) \in [-D_{y}/2,D_{y}/2] \times [-D_{z}/2,D_{z}/2], \end{aligned} $$
(1)
Fig. 1
figure 1

Configuration of a LNA system

where \(d(y,z,B_{0})=\sqrt {F^{2}+y^{2}+z^{2}} \) is the distance between the focus point B0 and the point (0,y,z) on the lens. With the phase shift designed such that, the phase delay from the lens input point (0,y,z) to an arbitrary point Bm(F,F tan(θm),0) can be denoted as

$$ \begin{aligned} \psi(y,z)+\frac{2\pi}{\lambda}d(y,z,B_{m})=\psi_{m}, \\ \end{aligned} $$
(2)

by combining (1) and (2), we may obtain

$$ {}\begin{aligned} \psi_{m}&=\psi_{0}+\frac{2\pi}{\lambda}d(y,z,B_{m})-\frac{2\pi}{\lambda}d(y,z,B_{0})\\ &=\psi_{0}+\frac{2\pi}{\lambda}\sqrt{F^{2}+(F\tan(\theta_{m})-y)^{2}+z^{2}} -\frac{2\pi}{\lambda}\sqrt{F^{2}+y^{2}+z^{2}}. \end{aligned} $$
(3)

Setting ψm=f(y), then we obtain

$$ {}\begin{aligned} \frac{\partial f(y)}{\partial y}&=\frac{2\pi}{\lambda}\frac{-F\sin(\theta_{m})\cos(\theta_{m})+y\cos(\theta_{m})^{2}} {\cos(\theta_{m})\sqrt{F^{2}-2Fy\sin(\theta_{m})\cos(\theta_{m})+y^{2}\cos(\theta_{m})^{2}+z^{2}\cos(\theta_{m})^{2}}}\\ &-\frac{2\pi}{\lambda}\frac{y}{\sqrt{F^{2}+y^{2}+z^{2}}}. \end{aligned} $$
(4)

Using the first-order Taylor approximation, we get

$$ \begin{aligned} f(y)&\approx f(0)+f^{'}(0)(y-0)\\ &=\psi_{0}+\frac{2\pi}{\lambda}\sqrt{\frac{F^{2}}{\cos(\theta_{m})^{2}}+z^{2}}-\frac{2\pi}{\lambda}\sqrt{F^{2}+z^{2}} \\ &-\frac{2\pi}{\lambda}\frac{F\sin(\theta_{m})}{\sqrt{F^{2}+\cos(\theta_{m})^{2}z^{2}}}(y-0). \end{aligned} $$

By considering that Fz, we have \(\sqrt {\frac {F^{2}}{\cos (\theta _{m})^{2}}+z^{2}}\approx \frac {F}{\cos (\theta _{m})}\) and \(\sqrt {F^{2}+z^{2}} \approx F\), \(\frac {F\sin (\theta _{m})}{\sqrt {F^{2}+\cos (\theta _{m})^{2}z^{2}}}(y-0) \approx y\sin (\theta _{m})\). Inserting the obtained results into (5) yields

$$ \begin{aligned} f(y)&\approx \psi_{0}+\frac{2\pi}{\lambda}\left(\frac{F}{\cos(\theta_{m})}-F-y\sin(\theta_{m})\right). \end{aligned} $$
(5)

We therefore assume that there is a uniform incident plane wave arriving at the lens with DoA ϕ as shown in Fig. 1. By considering that the thickness of the lens is negligible, then we obtain

$$ \begin{aligned} h(y,z)\approx h(y), \end{aligned} $$
(6)

and

$$ \begin{aligned} h(y)=Se^{-j\frac{2\pi}{\lambda}y\sin(\phi)}. \end{aligned} $$
(7)

According to the linear superposition principle [11], the signal received out of the the array can be formulated as

$$ \begin{aligned} Y(\theta_{m})&=\int_{-D_{z}/2}^{D_{z}/2}\int_{-D_{y}/2}^{D_{y}/2}h(y,z)e^{-j\psi_{m}}d_{y}d_{z}. \end{aligned} $$
(8)

Substituting (7) into (8), we obtain

$$ \begin{aligned} {}Y(\theta_{m})\approx e^{-j\psi_{0}}D_{z}\int_{-D_{y}/2}^{D_{y}/2}h(y)e^{-j\frac{2\pi}{\lambda}\left(\frac{F}{\cos(\theta_{m})}-F-y\sin(\theta_{m})\right)}d_{y}. \end{aligned} $$
(9)

Substituting (8) into (9), we obtain

$$ {}\begin{aligned} Y(\theta_{m})&= e^{-j\psi_{0}}D_{z}\int_{-D_{y}/2}^{D_{y}/2}Se^{-j\frac{2\pi}{\lambda}y\sin(\phi)}e^{-j\frac{2\pi}{\lambda} \left(\frac{F}{\cos(\theta_{m})}-F-y\sin(\theta_{m})\right)}d_{y}\\ &=e^{-j\psi_{0}}e^{-j\frac{2\pi}{\lambda}F\frac{1-\cos(\theta_{m})}{\cos(\theta_{m})}}D_{z}\!\int_{-D_{y}/2}^{D_{y}/2} \!Se^{-j\frac{2\pi}{\lambda}y\sin(\phi)}e^{j\frac{2\pi}{\lambda}y\sin(\theta_{m})}d_{y}\\ &=Se^{-j\psi_{0}}e^{-j\frac{2\pi}{\lambda}F\frac{1-\cos(\theta_{m})}{\cos(\theta_{m})}}D_{z} \int_{-D_{y}/2}^{D_{y}/2}\cos(2\pi/\lambda(\sin(\phi)\\ &-\sin(\theta_{m})))y-j\sin(2\pi/\lambda(\sin(\phi)-\sin(\theta_{m})))yd_{y}. \end{aligned} $$
(10)

According to the symmetry of the integral, it follows from (10) that

$$ {}\begin{aligned} Y(\theta_{m})&=Se^{-j\psi_{0}}e^{-j\frac{2\pi}{\lambda}F\frac{1-\cos(\theta_{m})}{\cos(\theta_{m})}}D_{z}\int_{-D_{y}/2}^{D_{y}/2} \cos(2\pi/\lambda(\sin(\phi)-\sin(\theta_{m})))yd_{y}\\ &=2Se^{-j\psi_{0}}e^{-j\frac{2\pi}{\lambda}F\frac{1-\cos(\theta_{m})}{\cos(\theta_{m})}}D_{z}\frac{1}{2\pi/\lambda(\sin(\phi_{n})-\sin(\theta_{m}))}\\ &\times\int_{0}^{D_{y}/2}\cos(2\pi/\lambda(\sin(\phi)-\sin(\theta_{m})))yd_{(2\pi/\lambda(\sin(\phi)-\sin(\theta_{m})))y}\\ &=Se^{-j\psi_{0}}e^{-j\frac{2\pi}{\lambda}F\frac{1-\cos(\theta_{m})}{\cos(\theta_{m})}}D_{z}D_{y}\text{sinc}(D_{y}/\lambda(\sin(\theta_{m})-\sin(\phi))). \end{aligned} $$
(11)

Without loss of generality, we have assumed that ψ0=2nπ for some integer n. Therefore, the phase term can be neglected and accordingly, we obtain

$$ \begin{aligned} {}Y(\theta_{m})\,=\,Se^{-j\frac{2\pi}{\lambda}F\frac{1-\cos(\theta_{m})}{\cos(\theta_{m})}}D_{z}D_{y}\text{sinc}(D_{y}/\lambda(\sin(\theta_{m})\,-\,\sin(\phi))). \end{aligned} $$
(12)

From (12), the array response of LNA can be obtained as

$$ \begin{aligned} a(\phi)_{m}=e^{-j\frac{2\pi}{\lambda}F\frac{1-\cos(\theta_{m})}{\cos(\theta_{m})}}\text{sinc}(D_{y}/\lambda(\sin(\theta_{m})-\sin(\phi))), \end{aligned} $$
(13)

where \(\cos (\theta _{m})=\frac {F}{\sqrt {F^{2}+(md)^{2}}}\) and \(\sin (\theta _{m})=\frac {md}{\sqrt {F^{2}+(md)^{2}}}\). We assume that the steering vector of LNA is a(ϕ) with its element a(ϕ)m, where m∈[−(N−1)/2,...,(N−1)/2]. To simplify the presentation, the signal received through LNA can be denoted as

$$ \begin{aligned} \mathbf{y}(t)=p\mathbf{a}(\phi)e^{jbt}+\mathbf{n}(t), \end{aligned} $$
(14)

where \(\mathbf {y}\in \mathbb {C}^{N\times 1}\) is the N×1 received signal vector, p is the transmit signal amplitude, b is the phase of the signal arrived at the lens, and n is the additive white Gaussian noise (AWGN) with covariance of σ2I, where I denotes the identity matrix.

The employment of large antenna arrays brings a number of new challenges. One of the most important challenges is that it increased signal processing complexity and hardware costs. In order to deal with such problem, antenna selection approach has received much attention [12, 13]. Through antenna selection, the proposed algorithm will choose the best receiving antenna subset G from the total receiving antennas N, where G<<N. This may reduce the number of required RF chains and the hardware costs. The best array element of LNA can be selected based on different criterias [12]. Since the lens has the ability of focusing the signal power on a subset of antennas as a function of DoAs, the maximal power approach can be tailored to choose an antennas which have the maximum power and its two nearby antennas. This can be expressed as:

$$ \begin{aligned} \breve{\mathbf{y}}=\breve{p}\breve{\mathbf{a}}(\phi)e^{j\breve{b}t}+\breve{\mathbf{n}}(t). \end{aligned} $$
(15)

Subsequently, we may use the selected antennas to obtain the angles of the signals. Let the vector representation of the received signal for several selected antennas denote as

$$ \begin{aligned} \mathbf{x}(t)=\breve{\mathbf{y}}. \end{aligned} $$
(16)

In practice, the covariance matrix can be computed via the following sample averaging:

$$ \begin{aligned} \hat{\mathbf{R}}=\frac{1}{L}\sum_{t=1}^{L}\mathbf{x}(t)\mathbf{x}^{H}(t), \end{aligned} $$
(17)

where L is the number of snapshots.

3 Proposed algorithm

In Section 2, we have derived an expression for the signal received out from the LNA structure. For the convergence of the 5G industries, it is very important to accurately estimating the DoAs of the signals and accordingly the directions of their sources. With this motivation, this paper focuses on evaluating the ML estimation for the DoA estimation using LNA. For the sake of simplicity, we define a parameter vector θ=[p,b,ϕ], where p,b,ϕ are the amplitude, phase, and DoAs of the received signal, respectively. By setting v=pa(ϕ)ebt, the probability density function (PDF) given the parameters vector θ is represented as

$$ \begin{aligned} f_{x}(x|\boldsymbol{\theta})=ce^{(\mathbf{x}-\mathbf{v})^{H}\mathbf{R}^{-1}(\mathbf{x}-\mathbf{v})}. \end{aligned} $$
(18)

where R−1=σ2I and c is a normalization constant. After dropping the constant term, the log-likelihood of (18) becomes

$$ {}\begin{aligned} g(p,\phi,b)&\triangleq \log(f_{x}(x|\boldsymbol{\theta}))\\ &=\frac{p}{\sigma^{2}}\left[pe^{-jb}\mathbf{a}(\phi)^{H}\mathbf{x}+pe^{jb}\mathbf{a}(\phi)\mathbf{x}^{H}-p\mathbf{a}^{H}(\phi)\mathbf{a}(\phi)\right]. \end{aligned} $$
(19)

To maximize the likelihood function, we assume that b and ϕ are constants. The derivative of p can be obtained as

$$ {}\begin{aligned} \frac{\partial g(p,\phi,b)}{\partial p}=\frac{1}{\sigma^{2}_{n}}\left[e^{-jb}\mathbf{a}^{H}(\phi)\mathbf{x}+e^{jb}\mathbf{a}(\phi)\mathbf{x}^{H}-\frac{2p}{\sigma^{2}_{n}}\mathbf{a}(\phi)^{H}\mathbf{a}(\phi)\right], \end{aligned} $$
(20)

When the derivative equals to 0, we can get

$$ \begin{aligned} p=\frac{e^{-jb}\mathbf{a}^{H}(\phi)\mathbf{x}+e^{jb}\mathbf{a}(\phi)\mathbf{x}^{2}}{2\mathbf{a}^{H}(\phi)\mathbf{a}(\phi)}. \end{aligned} $$
(21)

Substitute (21) into (19), we have

$$ \begin{aligned} g(\phi,b)=\frac{\left(e^{-jb}\mathbf{a}^{H}(\phi)\mathbf{x}+e^{jb}\mathbf{a}(\phi)\mathbf{x}^{2}\right)^{2}}{4\sigma^{2}\mathbf{a}^{H}(\phi)\mathbf{a}{\phi}}. \end{aligned} $$
(22)

By considering that ϕ is a constant, it follows form (21) that

$$ \begin{aligned} \frac{\partial g(\phi,b)}{\partial b}=-je^{-2jb}\left(\mathbf{a}^{H}(\phi)\mathbf{x}\right)^{2}+je^{2jb}\left(\mathbf{x}^{H} \mathbf{a}(\phi)\right)^{2}. \end{aligned} $$
(23)

Let aH(ϕ)x equals Mejφ, we obtain

$$ \begin{aligned} \frac{\partial g(\phi,b)}{\partial b}=-M^{2}e^{-2jb}e^{j\varphi}+M^{2}e^{2jb}e^{-j\varphi}. \end{aligned} $$
(24)

Then, when (24) equals to 0, we can obtain

$$ \begin{aligned} b=\varphi. \end{aligned} $$
(25)

Substituting from (25) into (22), we can obtain

$$ \begin{aligned} g(\phi)=\frac{M^{2}}{\sigma^{2}\mathbf{a}^{2}} =\frac{tr\left(\mathbf{a}^{H}\mathbf{x}\mathbf{x}^{H}\mathbf{a}\right)}{\sigma^{2}\mathbf{a}^{H}\mathbf{a}}. \end{aligned} $$
(26)

For multiple samples, the likelihood function equals the sum of the likelihood functions for each sample. So we can get

$$ \begin{aligned} \hat{\phi}&=\max \limits_{\phi} \sum_{i=1}^{L}\frac{tr\left(\mathbf{a}^{H}\mathbf{x}(i)\mathbf{x}(i)^{H}\mathbf{a}\right)}{\sigma^{2}\mathbf{a}^{2}}\\ &=\max \limits_{\phi} \frac{tr\left(\mathbf{a}^{H}\sum_{i=1}^{L}\mathbf{x}(i)\mathbf{x}(i)^{H}\mathbf{a}\right)}{\sigma^{2}\mathbf{a}^{2}}\\ &=\frac{\mathbf{a}^{H}R\mathbf{a}}{\sigma^{2}\mathbf{a}^{H}\mathbf{a}}. \end{aligned} $$
(27)

Up to now, we have presented the ML approach to DoA estimation using LNA. The proposed algorithm can be summarized as in Algorithm 1.

4 Simulation results and discussion

This section investigates the simulation result for the proposed ML approach for DoA estimation for the LNA structure. In all the experiments, we assume that the number of antenna elements N=21. The focal length F=50λ with λ=10−3 and Dy=10λ. The signal-noise ratio (SNR) is set to 0 dB. Figure 2 compares the normalized power of received signals with LNA with that of the conventional schemes with uniform linear array (ULA) at different values for the angle of incident signals, namely α=−10 and α=10. It is proven that the power of received signals with ULA evenly distributed between all antenna elements, implying that the angle of the input signal has no effect on the power distribution. However, the power of received signal with LNA can be focused on a subset of array antenna and changes with the DoAs of incident signal. The reason behind this fact is that the receive array response vector of LNA is a sinc function of the DoA, which is an aperiodic function, while the response vector with ULA is a periodic function.

Fig. 2
figure 2

Normalized power distribution comparison between LNA and ULA

According to the characteristics of the power distribution of LNA, we propose using it to avoid the phase ambiguity problem. We assume that the DoAs of incident signals are in the range [−10,10]. The obtained results are averaged over 100 simulation runs. The inter-element spacing d is assumed to be equal λ. Figure 3 shows the spatial spectrum of ML estimation with LNA and with ULA. The corresponding simulation result proves that the number of peaks with ULA and with LNA are 4 and 2, respectively. This is because the response vector with ULA is a periodic function. When d is much larger than λ/2, multiple angles can be achieved with the ML function, which causes the phase ambiguity. The response vector with LNA is sinc function. Regardless of the distance of antenna elements, there is only one angle to ML function. So it is easy to find the unique DoA and avoid phase ambiguity problem.

Fig. 3
figure 3

Performance comparison of estimated DoA with and without EM lens

Although the array structure of LNA can solve the phase ambiguity problem, large antenna arrays require an equivalent large number of RF chains. In order to tackle this problem, this paper makes full use of the distribution characteristics of signal power and employs the maximal power approach to select the corresponding antenna and two antennas around it. In order to estimate the angle of the incident signal, we just need to deal with the data on these three antennas. In order to verify the feasibility of this selection criteria, we assume that d equals to λ/2 and α=10. Spatial spectrum with ML estimation is illustrated in Fig. 3. The obtained results illustrate that the width of the main lobe using ULA with AS technique is greater than that achieved with other methods. This is because the power of received signals with ULA evenly distributed among all antenna elements, and the received signals using ULA with AS can lead to the lost of some parts of the signal received by the unselected antenna elements. The results also show that the width of the main lobe using LNA with AS is very close to the LNA without AS. Because LNA can focus the energy on a subset of antennas and the information of the received signal using LNA with AS is almost concentrated in whole in the selected antenna subset. This indicates that the AS technique can be effectively applied to the LAN, but it is not useful in ULA. In addition, the estimation performance of the proposed method is evaluated by the root-mean-square error (RMSE) criteria, which is expressed as

$$ \begin{aligned} {\text{RMSE}}=\frac{1}{P}\sum_{p=1}^{P}\sqrt{\frac{1}{K}\sum_{k=1}^{K}\left[\hat\theta_{k,p}-\theta_{k,p}\right]^{2}}, \end{aligned} $$
(28)

where P=100 is the number of independent trials. The results in Figs. 4 and 5 show that the performance of using ULA with AS technique is worse than the other methods. However, the performance difference between the other three methods is not obvious. Therefore, it is necessary to discuss the situation of multiple incident signals.

Fig. 4
figure 4

Estimated DOA with and without EM lens

Fig. 5
figure 5

RMSE of estimated DoA versus the SNR

In Fig. 6, we consider that there are two signals of θ:[−10,10] and the SNR equals to 0 dB. The results in this figure show that the ML approach using ULA with AS technique can not be used to estimate DoAs. This is because the resolution of DoA estimation is very low, when the number of selected antenna is three. Against this background, we would not consider the case of using ULA with AS techniques in that experiment as it is for sure will give worse performance that the case of LNA.

Fig. 6
figure 6

Estimated DOA with and without EM lens

To further demonstrate the advantages of using LAN with AS techniques, we assume that there are four signals with DoAs of θ:[−30,−10,10,30]. Figure 7 shows the performance of the proposed algorithm when SNR changes from − 5 dB to 5 dB. It is also obvious from Fig. 7 that increasing the SNR leads to a monotonic decrease of the RMSE value. When the SNR >1 dB, the three methods in the comparison achieve an identical performance. When the SNR <1 dB, the conventional scheme with ULA achieves better performance than the proposed method with LNA, and the proposed modification method with AS achieve the worst performance. This is because the systems with AS may lose copies of the signal received at other antenna elements. But the main advantage is that we just need to process the data out of only three antennas, which accordingly reduces signal processing complexity and hardware cost. In short, the proposed method is effective in estimating the DoAs of the signal, especially when SNR is very high.

Fig. 7
figure 7

RMSE of estimated DOAs versus the SNR

5 Conclusions

We have proposed a ML approach for DoA estimation for the LNA structure. We have derived an expression for the received signal with LNA structure, and then a ML estimator for DoA estimation using LNA is also derived. One of the most important characteristic of LNA is the ability for focusing the energy. It is illustrated that the power distribution of receive signals is a sinc function of the incident signal direction. As a result, we for the first time, propose the use of LNA for estimating DoA and avoiding phase ambiguity. Moreover, we propose the employment of AS techniques to reduce the number of RF chains. Simulation results show that the proposed method can effectively estimate the DoA, avoiding phase ambiguity and decreasing the number of RF chains to a maximum of three RF chains. The results displayed in this paper can be used as a guideline for designing LNA for 5G systems’ applications.