Electrical Engineering-University of California at Davis

Keqin Liu


About me

Research

Publications

Talks

Awards

 

 

 


 

Journal Publications

Submitted

K. Liu and Q. Zhao, "Stochastic Online Learning for Network Optimization under Random Unknown Weights,'' submitted to IEEE Transactions on Signal Processing, August, 2012.

K. Liu and Q. Zhao, "Intrusion Detection in Resource-Constrained Cyber Networks: A Restless Multi-Armed Bandit Approach,'' submitted to IEEE/ACM Transactions on Networking, April, 2012. Avialable at arXiv.org.

Sattar Vakili, K. Liu, and Q. Zhao, "Deterministic Sequencing of Exploration and Exploitation for Multi-Armed Bandit Problems,'' submitted to JSTSP-LBDM, 2013.

Published/To Appear

H. Liu, K. Liu, and Q. Zhao, "Learning in A Changing World: Restless Multi-Armed Bandit with Unknown Dynamics" pdf file, IEEE Transactions on Information Theory, November, 2011.

K. Liu and Q. Zhao, "Cooperative Game in Dynamic Spectrum Access with Unknown Model and Imperfect Sensing,'' pdf file, IEEE Transactions on Wireless Communications, vol. 11, no. 4, pp. 1596-1604, April, 2012.

P. Tehrani, K. Liu, and Q. Zhao, "Opportunistic Spectrum Access in Unslotted Primary Systems," Journal of The Franklin Institute, vol. 349, no. 3, pp. 985-1010, 2012; available online.

K. Liu and Q. Zhao, "Distributed Learning in Multi-Armed Bandit with Multiple Players" pdf file, IEEE Transactions on Signal Processing, vol. 58, no. 11, pp. 5667-5681, November, 2010. Also available at arXiv.org.

K. Liu and Q. Zhao, "Indexability of Restless Bandit Problems and Optimality of Whittle Index for Dynamic Multichannel Access" pdf file, IEEE Transactions on Information Theory, vol. 56, no. 11, pp. 5547-5567, November, 2010. Also available at arXiv.org.

K. Liu, Q. Zhao, and B. Krishnamachari, "Dynamic Multichannel Access with Imperfect Channel State Detection" pdf file, IEEE Transactions on Signal Processing, vol. 58, No. 5, pp. 2795 - 2808, May, 2010.

X. Xiao, K. Liu, and Q. Zhao, "Opportunistic Spectrum Access in Self Similar Primary Traffic" pdf file, EURASIP Journal on Advances in Signal Processing: Special Issue on Dynamic Spectrum Access for Wireless Networking, March, 2009.

Q. Zhao, B. Krishnamachari, and K. Liu, "On Myopic Sensing for Multi-Channel Opportunistic Access: Structure, Optimality, and Performance" pdf file, IEEE Transactions on Wireless Communications, vol. 7, no. 12, pp. 5431-5440, December, 2008.


Conference Publications

K. Liu and Q. Zhao, "Dynamic Intrusion Detection in Resource-Constrained Cyber Networks''arXiv full version, in Proc. of IEEE International Symposium on Information Theory, July, 2012.

K. Liu and Q. Zhao, "Adaptive Shortest-Path Routing under Unknown and Stochastically Varying Link States'' arXiv full version, in Proc. of the 10th Intl. Symposium on Modeling and Optimization in. Mobile, Ad Hoc, and Wireless Networks, May, 2012.

K. Liu and Q. Zhao, "Online Learning for Stochastic Linear Optimization Problems,'' in Proc. of Information Theory and Applications Workshop (ITA), February, 2012.

K. Liu, R.R. Weber, and Q. Zhao, "Indexability and Whittle Index for Restless Bandit Problems Involving Reset Processes" paper (pdf), slides (pdf), in Proc. of the 50th IEEE Conference on Decision and Control (CDC), December, 2011.

K. Liu and Q. Zhao, "Multi-Armed Bandit Problems with Heavy-Tailed Reward Distributions" paper (pdf), full version available at arXiv.org, in Proc. of Allerton Conference on Communications, Control, and Computing, September, 2011.

F. Lapiccirella, K. Liu, and Z. Ding, "Multi-channel Opportunistic Access Based on Primary ARQ Messages Overhearing" paper (pdf), in Proc. of IEEE International Conference on Communications (ICC), June, 2011.

H. Liu, K. Liu, and Q. Zhao, "Learning in A Changing World: Non-Bayesian Restless Multi-Armed Bandit" paper (pdf), slides (pdf), in Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May, 2011.

H. Liu, K. Liu, and Q. Zhao, "Learning and Sharing in A Changing World: Non-Bayesian Restless Bandit with Multiple Players" paper (pdf), slides (pdf), in Proc. of Information Theory and Applications Workshop (ITA), January, 2011.

K. Liu, Q. Zhao, and B. Krishnamachari, "Distributed Learning Under Imperfect Sensing in Cognitive Radio Networks" paper (pdf), slides (pdf), in Proc. of the 44th Asilomar Conference on Signals, Systems, and Computers, November, 2010 (one of the 9 finalists in the student paper contest).

K. Liu and Q. Zhao, "Learning from Collisions in Cognitive Radio Networks: Time Division Fair Sharing Without Pre-Agreement" paper (pdf), slides (pdf), in Proc. of IEEE Military Communication Conference (MILCOM), November, 2010.

K. Liu, Q. Zhao, and B. Krishnamachari, "Decentralized Multi-Armed Bandit with Imperfect Observations" paper (pdf), slides (pdf), in Proc. of Allerton Conference on Communications, Control, and Computing, September, 2010.

K. Liu and Q. Zhao, "Distributed Learning in Cognitive Radio Networks: Multi-Armed Bandit with Distributed Multiple Players" paper (pdf), full version, in Proc. of the 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).

K. Liu and Q. Zhao, "Decentralized Multi-Armed Bandit with Distributed Multiple Players" paper (pdf), slides (pdf), in Proc. of the 2010 Information Theory and Applications Workshop (ITA).

K. Liu and Q. Zhao, "On the Myopic Policy for a Class of Restless Bandit Problems with Applications in Dynamic Multichannel Access," journal version (pdf), in Proc. of the 48th IEEE Conference on Decision and Control (CDC), December, 2009.

K. Liu, X. Xiao, and Q. Zhao, "Opportunistic Spectrum Access in Self Similar primary Traffic" journal version (pdf), in Proc. of IEEE Military Communication Conference (MILCOM), November, 2008.

K. Liu and Q. Zhao, "Channel Probing for Opportunistic Access with Multi-channel Sensing'' paper (pdf), journal version (pdf), slides (pdf), in Proc. of IEEE Asilomar Conference on Signals, Systems, and Computers, October, 2008.

K. Liu, Q. Zhao, and Y. Chen, "Distributed Sensing and Access in Cognitive Radio Networks'' paper (pdf), in Proc. of 10th International Symposium on Spread Spectrum Techniques and Applications (ISSSTA), August, 2008 (invited).

K. Liu and Q. Zhao, "A Restless Bandit Formulation of Opportunistic Access: Indexablity and Index Policy'' paper (pdf), journal version (pdf), in Proc. of IEEE Workshop on Networking Technologies for Software Defined Radio (SDR) Networks, June, 2008 (invited).

K. Liu and Q. Zhao, "Link Throughput of Multi-Channel Opportunistic Access with Limited Sensing" paper (pdf), typo correction, journal version (pdf), slides (pdf), in Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), March, 2008.

Q. Zhao and K. Liu , "Detecting, Tracking, and Exploiting Spectrum Opportunities in Unslotted Primary Systems'' paper (pdf), slides (pdf), in Proc. of IEEE Radio and Wireless Symposium (RWS), January, 2008.

Q. Zhao, B. Krishnamachari, and K. Liu, "Low-Complexity Approaches to Spectrum Opportunity Tracking" paper (pdf), slides (pdf), in Proc. of the 2nd International Conference on Cognitive Radio Oriented Wireless Networks and Communications (CrownCom), August, 2007.


Technical Report

K. Liu and Q. Zhao, "Deterministic Sequencing of Exploration and Exploitation for Multi-Armed Bandit Problems'' arXiv full version.

K. Liu, Q. Zhao, and B. Krishnamachari, "Distributed Learning under Imperfect Sensing in Cognitive Radio Networks" pdf file, Supporting document for the paper submitted to 2010 IEEE Asilomar Conference on Signals, Systems, and Computers.

K. Liu and Q. Zhao, "Decentralized Multi-Armed Bandit with Multiple Distributed Players" available at arXiv.org, Supporting document for "Distributed Learning in Cognitive Radio Networks: Multi-Armed Bandit with Distributed Multiple Players" submitted to 2010 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).

K. Liu and Q. Zhao, "On the Myopic Policy for a Class of Restless Bandit Problems with Applications in Dynamic Multichannel Access" pdf file, Supporting document for "On the Myopic Policy for a Class of Restless Bandit Problems with Applications in Dynamic Multichannel Access" in Proc. of the 48th IEEE Conference on Decision and Control (CDC), December, 2009.

K. Liu and Q. Zhao, "Link Throughput of Multi-Channel Opportunistic Access with Limited Sensing" pdf file, Supporting document for "On Myopic Sensing for Multi-Channel Opportunistic Access: Structure, Optimality, and Performance" in IEEE Transactions on Wireless Communications, vol. 7, no. 12, pp. 5431-5440, December, 2008.