Abstract:  An information theoretic perspective on a classical sparse-sampling noisy linear model is taken. Analytical expressions for mutual information terms which play central role in a variety of communications/processing problems are presented. Such expressions were addressed previously either by bounds, by simulations or by the (non-rigorous) replica method. The expressions for the relevant mutual information terms are based on techniques used in [Huleihel-Merhav, 2013], addressing the minimum mean square error (MMSE) analysis. These take a statistical mechanics view, via partition functions and invoke classical random matrix results for functionals of the Stieltjes and Shannon transforms.
Using the analytical mutual information expressions, a variety of sparse linear communications models are addressed. These include timely frameworks as coding in different settings, accounting also for multiple access channels and different wiretap problems. For those models, single-letter expressions for achievable rates are derived, capturing their communications/processing features.
------------------------------------------------------------------
Joint work with Wasim Huleihel and Neri Merhav (Technion).
 
 
Bio:  Shlomo Shamai (Shitz) received the B.Sc., M.Sc., and Ph.D. degrees in electrical engineering from the Technion---Israel Institute of Technology, in 1975, 1981 and 1986 respectively. During 1975-1985 he was with the Communications Research Labs, in the capacity of a Senior Research Engineer. Since 1986 he is with the Department of Electrical Engineering, Technion---Israel Institute of Technology, where he is now a Technion Distinguished Professor, and holds the William Fondiller Chair of Telecommunications. His research interests encompass a wide spectrum of topics in information theory and statistical communications.
Dr. Shamai (Shitz) is an IEEE Fellow, a member of the Israeli Academy of Sciences and Humanities and a foreign member of the US National Academy of Engineering. He is the recipient of the 2011 Claude E. Shannon Award and the 2014 Rothschild Prize in Mathematics/Computer Sciences and Engineering.  He has been awarded the 1999 van der Pol Gold Medal of the Union Radio Scientifique Internationale (URSI), and is a co-recipient of the 2000 IEEE Donald G. Fink Prize Paper Award, the 2003, and the 2004 joint IT/COM societies paper award, the 2007 IEEE Information Theory Society Paper Award, the 2009 European Commission FP7, Network of Excellence in Wireless COMmunications (NEWCOM++) Best Paper Award, the 2010 Thomson Reuters Award for International Excellence in Scientific Research, and the 2014 EURASIP Best Paper Award (for the EURASIP Journal on Wireless Communications and Networking). He is also the recipient of 1985 Alon Grant for distinguished young scientists and the 2000 Technion Henry Taub Prize for Excellence in Research. He has served as Associate Editor for the Shannon Theory of the IEEE Transactions on Information Theory, and has also served twice on the Board of Governors of the Information Theory Society. He has served on the Executive Editorial Board of the IEEE Transactions on Information Theory.