CHAPTER Information-Theoretic Analysis of Neural Data 3 Don H. Johnson Department of Electrical and Computer Engineering Rice University, Houston, Texas 3.1 INTRODUCTION Shannon's classic work (Shannon, 1948) founded the field we know today as information theory. His foundational work and enhancements made over the years determine the ultimate fidelity limits that communication and sig- nal processing systems can achieve. It is the generality of his results that hallmarks information theory: No specific cases need be assumed or special