eleanor oliphant desmond elliott 2017 rebus 30th anniversary
Search our site
The Stolen Bicycle by Ming-Yi Wu Read the opening extract of the brand new Ming-Yi Wu book before its publication on 26/10/2017

Information Theoretic Learning Renyi's Entropy and Kernel Perspectives by Jose C. Principe

Information Theoretic Learning Renyi's Entropy and Kernel Perspectives

Part of the Information Science and Statistics Series

RRP £115.50


Information Theoretic Learning Renyi's Entropy and Kernel Perspectives by Jose C. Principe

This bookisan outgrowthoften yearsof researchatthe Universityof Florida Computational NeuroEngineering Laboratory (CNEL) in the general area of statistical signal processing and machine learning. One of the goals of writing the book is exactly to bridge the two ?elds that share so many common problems and techniques but are not yet e?ectively collaborating. Unlikeotherbooks thatcoverthe state ofthe artinagiven?eld,this book cuts across engineering (signal processing) and statistics (machine learning) withacommontheme:learningseenfromthepointofviewofinformationt- orywithanemphasisonRenyi'sde?nitionofinformation.Thebasicapproach is to utilize the information theory descriptors of entropy and divergence as nonparametric cost functions for the design of adaptive systems in unsup- vised or supervised training modes. Hence the title: Information-Theoretic Learning (ITL). In the course of these studies, we discovered that the main idea enabling a synergistic view as well as algorithmic implementations, does not involve the conventional central moments of the data (mean and covariance). Rather, the core concept is the ?-norm of the PDF, in part- ular its expected value (? = 2), which we call the information potential. This operator and related nonparametric estimators link information theory, optimization of adaptive systems, and reproducing kernel Hilbert spaces in a simple and unconventional way.


From the book reviews: The book is remarkable in various ways in the information it presents on the concept and use of entropy functions and their applications in signal processing and solution of statistical problems such as M-estimation, classification, and clustering. Students of engineering and statistics will greatly benefit by reading it. (C. R. Rao, Technometrics, Vol. 55 (1), February, 2013)

About the Author

Jose C. Principe is Distinguished Professor of Electrical and Biomedical Engineering, and BellSouth Professor at the University of Florida, and the Founder and Director of the Computational NeuroEngineering Laboratory. He is an IEEE and AIMBE Fellow, Past President of the International Neural Network Society, Past Editor-in-Chief of the IEEE Trans. on Biomedical Engineering and the Founder Editor-in-Chief of the IEEE Reviews on Biomedical Engineering. He has written an interactive electronic book on Neural Networks, a book on Brain Machine Interface Engineering and more recently a book on Kernel Adaptive Filtering, and was awarded the 2011 IEEE Neural Network Pioneer Award.

More books by this author
Author 'Like for Like' recommendations

Loading other formats...

Book Info

Publication date

27th May 2012


Jose C. Principe

More books by Jose C. Principe
Author 'Like for Like'


Springer-Verlag New York Inc.


448 pages


Computer science
Artificial intelligence
Imaging systems & technology
Artificial intelligence
Probability & statistics
Geographical information systems (GIS) & remote sensing



Lovereading is not only an amazing site, but it's one of my very favourites. It's like visiting a fascinating bookstore, but better.

Rebecca Jayne Barrett

Lovereading is pitched at just the right level for all the various types of people who enjoy reading in its many forms.

Pam Woodburn

Love books. Love reading. Love reading books. And, here's the trick. Here's a website which caters for people like me.

Ian Harvey-brown

If you LOVE reading then you will love LOVEREADING! It's a 'novel' idea. Seriously though I could not recommend them enough.

Rebecca Whymark

If you love reading, then you'll love Lovereading! Full of tips & info for every discerning reader.

Lynne Rapson

Their sending me my first book to review 18 months ago re-awakened my fondness for reading, since then I have purchased some real gems.

Barry Griffiths

I love Lovereading because I get to read great books and then get to tell everybody how good they are.

Sally Doel

Love Reading - it not only does what it says on the tin, it does it with Jam on!!

Maz Tucker