Information Loss in Deterministic Signal Processing Systems

Softcover Nachdruck of the original 1. Auflage 2018
ISBN: 978-3-319-86645-1
Verlag: Springer International Publishing

Buch, Englisch, 145 Seiten, Previously published in hardcover, Format (B × H): 155 mm x 235 mm, Gewicht: 254 g

Reihe: Understanding Complex Systems

This book introduces readers to essential tools for the measurement and analysis of information loss in signal processing systems. Employing a new information-theoretic systems theory, the book analyzes various systems in the signal processing engineer’s toolbox: polynomials, quantizers, rectifiers, linear filters with and without quantization effects, principal components analysis, multirate systems, etc. The user benefit of signal processing is further highlighted with the concept of relevant information loss. Signal or data processing operates on the physical representation of information so that users can easily access and extract that information. However, a fundamental theorem in information theory—data processing inequality—states that deterministic processing always involves information loss. 
These measures form the basis of a new information-theoretic systems theory, which complements the currently prevailing approaches based on second-order statistics, such as the mean-squared error or error energy. This theory not only provides a deeper understanding but also extends the design space for the applied engineer with a wide range of methods rooted in information theory, adding to existing methods based on energy or quadratic representations.

Zielgruppe

Research

Autoren/Hrsg.

Kubin, Gernot

Geiger, Bernhard C.

Fachgebiete

• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Informationstheorie, Kodierungstheorie
• Naturwissenschaften Physik Angewandte Physik Statistische Physik, Dynamische Systeme
• Technische Wissenschaften Elektronik | Nachrichtentechnik Nachrichten- und Kommunikationstechnik Signalverarbeitung
• Interdisziplinäres Wissenschaften Wissenschaften: Forschung und Information Informationstheorie, Kodierungstheorie
• Mathematik | Informatik EDV | Informatik Informatik Berechenbarkeitstheorie, Komplexitätstheorie

Inhaltsverzeichnis

Introduction.- Part I: Random Variables.- Piecewise Bijective Functions and Continuous Inputs.- General Input Distributions.- Dimensionality-Reducing Functions.- Relevant Information Loss.- II. Part II: Stationary Stochastic Processes.- Discrete-Valued Processes.- Piecewise Bijective Functions and Continuous Inputs.- Dimensionality-Reducing Functions.- Relevant Information Loss Rate.- Conclusion and Outlook.