Covert Communication with Finite Blocklength in AWGN Channels
Abstract
Covert communication is to achieve a reliable transmission from a transmitter to a receiver while guaranteeing an arbitrarily small probability of this transmission being detected by a warden. In this work, we study the covert communication in AWGN channels with finite blocklength, in which the number of channel uses is finite. Specifically, we analytically prove that the entire block (all available channel uses) should be utilized to maximize the effective throughput of the transmission subject to a predetermined covert requirement. This is a nontrivial result because more channel uses results in more observations at the warden for detecting the transmission. We also determine the maximum allowable transmit power per channel use, which is shown to decrease as the blocklength increases. Despite the decrease in the maximum allowable transmit power per channel use, the maximum allowable total power over the entire block is proved to increase with the blocklength, which leads to the fact that the effective throughput increases with the blocklength.
I Introduction
In future wireless networks, the demand for wireless data is growing at such a rate that requires 1000x today’s capacity in the next five to ten years. Against this background, crucial concerns on the security and privacy of wireless communications are emerging since a large amount of confidential information (e.g., email/bank account information and password, credit card details) is transferred over wireless networks. In addition to the secrecy and integrity of the transmitted information, in some scenarios a user may wish to transmit messages over wireless networks without being detected. This is due to the fact that (for example) the exposure of this transmission may disclose the user’s location information, which probably violates the privacy of the user. Therefore, covert communication is attracting an increasing amount of research interests recently (e.g., [1, 2, 3]). In covert communication, a transmitter (Alice) intends to communicate with a legitimate receiver (Bob) without being detected by a warden (Willie), who is observing this communication.
In fact, covert communication was addressed by spread spectrum techniques in the early 20th century and a review on spread spectrum techniques can be found in [4]. However, the performance limit of covert communication has not been fully examined in the literature and recently attracts much research attention. Considering additive white Gaussian noise (AWGN) channels, a square root law has been derived in [5], which states that Alice can transmit no more than bits in channel uses covertly and reliably to Bob. Following [5], the scaling constant of the amount of information with respect to the square root of was characterized for a broad class of discrete memoryless channels (DMCs) and AWGN channels in [6]. We note that this square root law requires a pre-shared secret to be established between Alice and Bob prior to Alice’s transmission. This pre-shared secret is proved to be unnecessary for the square root law when the channel quality from Alice to Bob is higher than that from Alice to Willie, for binary symmetric channel (BSC) [7], DMC [8], and AWGN channel [8].
In the square root law we have as , which states that the rate is asymptotically zero (i.e., the average number of bits that can be covertly and reliably transmitted per channel use asymptotically approaches zero). However, in some scenarios a positive rate has been proved to be achievable (e.g., [7, 9, 10, 11, 12, 13]). For example, it is proved that a positive rate can be obtained when Willie has uncertainty about the receiver noise variance in AWGN channels [11, 13], when Willie does not exactly know the receiver noise model in BSC channels [7], or when Willie lacks knowledge of his channel characteristics in AWGN and block fading channels [12, 13]. In addition to the noise or channel uncertainty, as proved in [10] a positive rate can also be achieved when Willie has uncertainty on the time instant of the communication.
In the literature as seen in the aforementioned works, only [11] mentioned the impact of finite samples (i.e., finite ) on the detection performance at Willie. It is numerically shown that with noise uncertainty at Willie there may exist an optimal number of samples that maximizes the communication rate subject to , where is the sum of false positive and miss detection rates at Willie and is an arbitrarily small number. Besides the detection performance at Willie, finite also has significant impact on the maximal achievable rate of the channel from Alice to Bob (i.e., the maximal achievable rate decreases as decreases for a fixed decoding error probability ) [14], which has not been considered in the literature of covert communication (including [11]). Therefore, the impact of finite on covert communication has not been well examined. This leaves a significant gap in our understanding of the performance limit of practical covert communication, since in practice the length of a codeword is always finite. For example, to achieve transmission efficiency (e.g., short delay) we may require the codeword to be short (e.g., in the order of channel uses) for vehicle-to-vehicle communication or real-time video processing [15].
I-A Our Contributions
Considering AWGN channels, we study the impact of finite on both the maximal achievable rate at Bob and detection performance at Willie in covert communication. To this end, noting that the decoding error probability is not negligible when is finite, we first propose to adopt the effective throughput (i.e., ) subject to , as the performance metric to evaluate covert communication. As can be seen from the definition of , it explicitly captures the tradeoff among , , and for a given covert requirement.
We consider a maximum blocklength of channel uses, in which the covert information needs to be transmitted. Hence, the actual number of channel uses is constrained by . Although a larger offers more observations to Willie for detecting the transmission, we analytically prove that the optimal value of that maximizes subject to the given covert requirement is (i.e., the entire block with all available channel uses). We also determine the maximum allowable transmit power per channel use (denoted by ) that achieves the maximum . Our examination shows that decreases as increases, which is due to the fact that increasing forces Alice to allocate less power for each channel use to meet the covert requirement. Nevertheless, we show that the maximum allowable total transmit power (i.e., ) increases as increases, which leads to the fact that the effective throughput of the communication from Alice to Bob increases as increases. The results in this paper, for the first time, provide important insights on the design of covert communication with a finite blocklength.
Notations: Scalar variables are denoted by italic symbols. Vectors and matrices are denoted by lower-case and upper-case boldface symbols, respectively. Given a vector , denotes the -th element of . The expectation is denoted by and denotes the circularly-symmetric complex normal distribution with zero mean and variance .
II System Model
II-A Channel Model
![Refer to caption](x1.png)
The system model of interest for covert communication is illustrated in Fig. 1, where each of Alice, Bob, and Willie is equipped with a single antenna. We assume the channel from Alice to Bob and the channel from Alice to Willie are only subject to AWGN. In the covert communication, Alice transmits complex-valued symbols () in each codeword to Bob, while Willie is passively collecting observations on Alice’s transmission to detect her presence (i.e., whether Alice is transmitting). In this work, we consider that the length of a codeword is constrained by a maximum blocklength denoted by . Thus, we have as a constraint on . We denote the AWGN at Bob and Willie as and , respectively, where , , and are the noise variances at Bob and Willie, respectively. In addition, we assume that , , and are mutually independent. We denote the transmit power of Alice as (i.e., ). Furthermore, we assume that Alice adopts Gaussian signaling, i.e., .
II-B Channel Coding Rate for Finite Blocklength
The received signal at Bob for each signal symbol is given by
(1) |
As pointed out by [14], the decoding error probability at Bob is not negligible when is finite. As such, for a given decoding error probability the channel coding rate of the channel from Alice to Bob can be approximated by [14, 16]
(2) |
where is the signal-to-noise ratio (SNR) at Bob, and is the inverse Q-function. Equivalently, for a given channel coding rate , the decoding error probability at Bob is given by
(3) |
II-C Binary Hypothesis Testing at Willie
In order to detect Alice’s presence, Willie is to distinguish the following two hypotheses
(4) |
where denotes the null hypothesis where Alice is not transmitting, denotes the alternative hypothesis where Alice is transmitting, and is the received signal at Willie. Following the assumptions detailed in Section II-A, we have the likelihood functions of under and as and , respectively. In the cover communication, the ultimate goal of Willie is to minimize the total error rate, which is given by
(5) |
where is the false positive rate, is the miss detection rate, and are the binary decisions that infer whether Alice is present or not, respectively. We assume that Willie knows both and exactly, and thus the optimal test that minimizes is the likelihood ratio test with as the threshold111We note that is due to the unknown or equal a priori probabilities, i.e., and are unknown or equal, where is the a priori probability that is true, is the a priori probability that is true, and . If both and are known, the total error rate is reformulated as and the optimal test that minimizes this reformulated is the likelihood ratio test with . We also note that the assumption of equal a priori probabilities is commonly adopted in the literature of covert communication (e.g., [5, 10, 11])., which is given by
(6) |
After performing some algebraic manipulations, (6) can be reformulated as
(7) |
where is the average power of each received symbol at Willie and is the threshold for , which is given by
(8) |
As per (6) and (7), we note that the radiometer is indeed the optimal detector when Willie knows the likelihood functions exactly (i.e., there are no nuisance parameters embedded in the likelihood functions). Following (7) and noting that is a chi-squared random variable with degrees of freedom, the false positive rate and miss detection rate are given by [9, 11]
(9) | ||||
(10) |
where is the gamma function and is the incomplete gamma function given by
(11) |
With the radiometer as the optimal detector, following Pinsker’s inequality, we have a lower bound on , which is given by [5, 17, 18]
(12) |
where is the Kullback-Leibler (KL) divergence from to , which can be expressed as
(13) |
II-D Covert Requirement
Covert communication requires for some arbitrarily small . As per (12), we can ensure in order to guarantee . We note that is a more strict constraint relative to as per (12). From a conservative point of view and to avoid the complex expressions for and , in this work we adopt as the requirement for covert communication. Also, the value of is especially very small in order to provide good covertness. Thus, in this work we only consider because means that Willie is allowed to achieve more than 50% success detection rate.
III Covert Communication with A Finite Number of Channel Uses
In this section, we first adopt the effective throughput to evaluate the performance of covert communication in AWGN channels with finite blocklength. Then, we determine the optimal and that maximize this effective throughput subject to the covert requirement.
III-A Effective Throughput
The square root law states that Alice can transmit no more than bits in channel uses covertly and reliably to Bob. Such scaling-law results are obtained when . As such, these square-law results cannot be applied in the covert communication with finite . In this work, we focus on the amount of information that can be transmitted reliably from Alice to Bob for a given positive . Noting that the decoding error probability of a channel with finite blocklength is not negligible, we adopt the effective throughput from Alice to Bob as the main performance metric for the covert communication with finite blocklength, while utilizing the covert requirement as the constraint. The effective throughput from Alice to Bob is defined as [20, 19]
(14) |
We note that gives the average number of information bits that can be transmitted from Alice to Bob reliably (excluding information bits suffering from decoding errors) by utilizing a codeword with finite length .
III-B Optimal Number of Channel Uses and Transmit Power
The ultimate goal of our design in covert communication is to achieve the maximum effective throughput while guaranteeing the covert requirement. To this end, we first consider a fixed channel coding rate and focus on the design of the number of channel uses and the transmit power , since the design of and affects both the effective throughput from Alice to Bob and the detection performance at Willie. As such, for a given the optimization problem in the covert communication of interest can be written as
(15) | |||
(16) | |||
(17) |
Theorem 1
The optimal values of and that maximize the effective throughput subject to and are derived as
(18) | ||||
(19) |
where is the solution to the fixed-point equation (19).
Proof:
The detailed proof is provided in Appendix. ∎
Based on Theorem 1, we see that it is best for Alice to transmit over all available channel uses for covert communication, provided that the transmit power is optimized to maintain the same level of covertness despite that Willie has more observations when is larger. The same level of covertness is achieved by reducing the transmit power when becomes larger, which can be seen from (19) that decreases with . It is interesting to observe that both and are not functions of . This demonstrates that the obtained and are globally optimal, regardless the value of the channel coding rate . As such, the optimal value of that maximizes the effective throughput subject to the covert requirement can be obtained through
(20) |
where is obtained by substituting and into (3). We note that can be also obtained through searching the optimal value of that maximizes for and . We define and denote the maximum effective throughput as , which is achieved by substituting , , , and into (14).
IV Numerical Results
In this section, we provide numerical results on the effective throughput subject to to verify our analysis on the covert communication with as the constraint.
![Refer to caption](x2.png)
In Fig. 2 we plot the maximum allowable total transmit power over the entire block versus . In this figure and the following figures, the curves for are achieved by numerically evaluating the false positive and detection rates as per (9) and (10), respectively. In this figure, we observe that the with as the constraint is higher than that with as the constraint. This is due to the fact that the equality in (12) cannot be achieved in the considered system model, and hence is a more strict constraint than . We also observe that increases (hence the effective throughput increases) as increases, which can be explained by our Theorem 1. Finally, we observe that decreases (hence the effective throughput decreases) as decreases, which demonstrates the tradeoff between the covert requirement and the achievable effective throughput (e.g., a more strict covert requirement leads to a smaller effective throughput).
![Refer to caption](x3.png)
In Fig. 3, we plot , , , and versus in different sub-figures, respectively. As expected, we first observe that and monotonically increase as increases in Fig. 3 (a) and Fig. 3 (b), respectively. Although increases as shown in Fig. 3 (a), it is interesting to observe that the maximum allowable transmit power monotonically decreases as increases in Fig. 3 (c). This can be explained by (19) in our Theorem 1. Intuitively, this is due to the fact that as the number of observations at Willie increases, Alice has to reduce her transmit power in order to meet the same detection performance at Willie. In Fig. 3 (d), we observe that the effective throughput per channel use (i.e., ) monotonically increases as increases. This is due to the fact that the decrease in (i.e., the decoding error probability given in (3)) caused by increasing is more than the increase in caused by the reduction of as shown in Fig. 3 (c). These aforementioned observations based on Fig. 3 demonstrate that increasing not only helps Alice to allocate less transmit power to each channel use in order to maintain the same level of covertness, but also reduces the decoding error probability in the communication from Alice to Bob, which turns out to improve the effective throughput of the covert communication.
![Refer to caption](x4.png)
In Fig. 4, we plot the effective throughput subject to versus the decoding error probability . We first observe that the optimal value of that maximizes indeed exists, based on which we can determine the optimal . We also observe that the optimal value of decreases as increases. As shown in Fig. 3 (c), the maximum allowable transmit power decreases as increases. As per (2), the observation, that both and decreases as increases, indicates that the optimal channel coding rate decreases as increases. We also plot the maximum effective throughput per channel use (i.e., ) versus in Fig. 5. In this figure, we first observe that as increases increases, which is consistent with our observation found in Fig. 3 (d). We also observe that as increases slightly (e.g., from to ) significantly increases. This demonstrates that the achievable effective throughput is very sensitive to the the covert requirement.
V Conclusion
This work investigated the covert communication with finite blocklength (i.e., a finite number of channel uses ) over AWGN channels. We proved that the effective throughput of covert communication is maximized when all available channel uses are utilized, i.e., . To guarantee the same level of covertness, the maximum allowable transmit power per channel use decreases as increases, while the maximum allowable total transmit power over all channel uses increases as increases. In contrast, we found that both the effective throughput and the effective throughput per channel use increase as increases. This is due to the fact that increasing not only reduces the transmit power allocated to each channel use, but also decreases the decoding error probability of the communication from Alice to Bob.
Acknowledgments
This work was supported by the Australian Research Council’s Discovery Projects (DP150103905).
![Refer to caption](x5.png)
Appendix
We present our proof of Theorem 1 in the following 6 steps.
Step 1: We note that and are both monotonically increasing functions of and . As such, we can conclude that the equality in the constraint (16) is always met in order to maximize . Thus, we have and following (13) we have
(21) |
where
(22) |
and is the SNR at Willie.
Step 2: We note and we derive the first derivative of with respect to as
(23) |
which leads to the fact that is a monotonically increasing function of . With the constraint , is a monotonically decreasing function of as per (21), which results in that is a monotonically decreasing function of (thus of ).
Step 3: Instead of directly proving for maximizing the effective throughput, we next prove that maximizes (i.e., maximizes ) under the constraint (21) in the remaining steps. This is due to the fact that is the total transmit power for the channel uses and the effective throughput increases as the total transmit power increases [14].
Step 4: We next prove that either or maximizes . To this end, in the following we first show that initially decreases and then increases with . Following (21) and (22), we have
(24) |
where is given by
(25) |
We then derive the first derivative of with respect to as
(26) |
where
(27) |
We note that there are only two solutions to for , including and .222We obtain by numerically solving . We also note that as we have . Then, we can conclude that for and for . As such, noting and following (26), we have for and for . This indicates that initially increases and then decreases with . As per (24), we know that monotonically decreases with , which leads to the fact that first decreases and then increases as increases (i.e., has one minimum value but no maximum value). We recall that is a monotonically decreasing function of under the constraint (21), which is proved following (23). Therefore, we conclude that first decreases and then increases as increases, and thus the maximum value of is achieved either at or .
Step 5: We next prove that (not ) maximizes . Substituting into (21), we have . For , we have due to . When , increases with due to . As such, for the optimal value of that maximizes is (i.e., ). For , we have again due to . We next confirm that even for we still have . To this end, we only have to confirm for is larger than that for . When , following (21) we have . The maximum value of that guarantees (i.e., ) is obtained when since is a monotonically increasing function of as proved by (23). We obtain this maximum value by solving as , which leads to when . When , following (21) we have . The minimum value of that guarantees (i.e., ) is obtained when . We obtain this minimum value by solving as , which leads to when . As such, we have when and when , which results in for is larger than for . We recall that monotonically increases with when . Therefore, for the optimal value of that maximizes is .
References
- [1] P. H. Che, S. Kadhe, M. Bakshi, C. Chan, S. Jaggi, and A. Sprintson, “Reliable, deniable and hidable communication: A quick survey,” in Proc. IEEE Inf. Theory Workshop, Nov. 2014, pp. 227–231.
- [2] B. A. Bash, D. Goeckel, D. Towsley, and S. Guha, “Hiding information in noise: Fundamental limits of covert wireless communication,” IEEE Commun. Mag., vol. 53, no. 12, pp. 26–31, Dec. 2015.
- [3] B. He, S. Yan, X. Zhou, and V. Lau, “On covert communication with noise uncertainty,” IEEE Commun. Lett., accepted to appear, DOI: 10.1109/LCOMM.2016.2647716, Dec. 2016.
- [4] M. K. Simon, Jim K. Omura, Robert A. Scholtz, and Barry K. Levitt, Spread Spectrum Communications Handbook, McGraw-Hill, 1994.
- [5] B. Bash, D. Goeckel, and D. Towsley, “Limits of reliable communication with low probability of detection on AWGN channels,” IEEE J. Sel. Areas Commun., vol. 31, no. 9, pp. 1921–1930, Sep. 2013.
- [6] L. Wang, G. Wornell, and L. Zheng, “Fundamental limits of communication with low probability of detection,” IEEE Trans. Inf. Theory, vol. 62, no. 6, pp. 3493–3503, Jun. 2016.
- [7] P. H. Che, M. Bakshi, and S. Jaggi, “Reliable deniable communication: Hiding messages in noise,” in Proc. IEEE Int’l. Symp. Info. Theory, Jul. 2013, pp. 2945–2949.
- [8] M. R. Bloch, “Covert communication over noisy channels: A resolvability perspective,” IEEE Trans. Inf. Theory, vol. 62, no. 5, pp. 2334–2354, May 2016.
- [9] S. Lee and R. Baxley, “Achieving positive rate with undetectable communication over AWGN and Rayleigh channels,” in Proc. IEEE ICC, 2014, Jun. 2014, pp. 780–785.
- [10] B. A. Bash, D. Goeckel, and D. Towsley, “LPD communication when the warden does not know when,” in Proc. IEEE Int. Symp. Inf. Theory, Jul. 2014, pp. 606–610.
- [11] S. Lee, R. J. Baxley, M. A. Weitnauer, and B. Walkenhorst, “Achieving undetectable communication,” IEEE J. Sel. Topics Signal Process., vol. 9, no. 7, pp. 1195–1205, Oct. 2015.
- [12] T. Sobers, B. Bash, D. Goeckel, S. Guha, and D. Towsley, “Covert communication with the help of an uninformed jammer achieves positive rate,” in Proc. Asilomar Conf. on Signals, Systems, and Comput., Nov. 2015, pp. 625–629.
- [13] D. Goeckel, B. Bash, S. Guha, and D. Towsley, “Covert communications when the warden does not know the background noise power,” IEEE Commun. Lett., vol. 20, no. 2, pp. 236–239, Feb. 2016.
- [14] Y. Polyanskiy, H. Poor, and S. Verdu, “Channel coding rate in the finite blocklength regime,” IEEE Trans. Inf. Theory, vol. 56, no. 5, pp. 2307–2359, May 2010.
- [15] B. Makki, T. Svensson, and M. Zorzi, “Finite block-length analysis of spectrum sharing networks using rate adaptation,” IEEE Trans. Commun., vol. 63, no. 8, pp. 2823–2835, Aug. 2015.
- [16] G. Ozcan andM. C. Gursoy, “Throughput of cognitive radio systems with finite blocklength codes,” IEEE J. Sel. Areas Commun., vol. 31, no. 11, pp. 2541–2554, Nov. 2013.
- [17] E. Lehmann and J. Romano, Testing Statistical Hypotheses, 3rd ed. New York: Springer, 2005.
- [18] T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. John Wiley & Sons, Hoboken, NJ, 2002.
- [19] X. Zhou, M. R. McKay, B. Maham, and A. Hjørungnes, “Rethinking the secrecy outage formulation: A secure transmission design perspective,” IEEE Commun. Lett., vol. 15, no. 3, pp. 302–304, Mar. 2011.
- [20] S. Yan, N. Yang, G. Geraci, R. Malaney, and J. Yuan, “Optimization of code rates in SISOME wiretap channels,” IEEE Trans. Wireless Commun., vol. 14, no. 11, pp. 6377–6388, Nov. 2015.