Toward a theory of information processing

S Sinanovic; D H Johnson

doi:10.1109/ISIT.2000.866791

Toward a theory of information processing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.

Original language	English
Title of host publication	Proceedings of the IEEE International Symposium on Information Theory
Publisher	IEEE
ISBN (Print)	0-7803-5857-0
DOIs	https://doi.org/10.1109/ISIT.2000.866791
Publication status	Published - 2000

Keywords

information processing
control systems
data processing theorem

Documents and Links

10.1109/ISIT.2000.866791

Cite this

Sinanovic, S., & Johnson, D. H. (2000). Toward a theory of information processing. In Proceedings of the IEEE International Symposium on Information Theory IEEE. https://doi.org/10.1109/ISIT.2000.866791

@inproceedings{1acc7b882a384a5f928c255dd94ff8fe,

title = "Toward a theory of information processing",

abstract = "Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.",

keywords = "information processing, control systems, data processing theorem",

author = "S Sinanovic and Johnson, {D H}",

year = "2000",

doi = "10.1109/ISIT.2000.866791",

language = "English",

isbn = "0-7803-5857-0",

booktitle = "Proceedings of the IEEE International Symposium on Information Theory",

publisher = "IEEE",

}

TY - GEN

T1 - Toward a theory of information processing

AU - Sinanovic, S

AU - Johnson, D H

PY - 2000

Y1 - 2000

N2 - Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.

AB - Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.

KW - information processing

KW - control systems

KW - data processing theorem

U2 - 10.1109/ISIT.2000.866791

DO - 10.1109/ISIT.2000.866791

M3 - Conference contribution

SN - 0-7803-5857-0

BT - Proceedings of the IEEE International Symposium on Information Theory

PB - IEEE

ER -