Toward a theory of information processing

S Sinanovic; D H Johnson

doi:10.1109/ISIT.2000.866791

Toward a theory of information processing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.

Original language	English
Title of host publication	Proceedings of the IEEE International Symposium on Information Theory
Publisher	IEEE
ISBN (Print)	0-7803-5857-0
DOIs	https://doi.org/10.1109/ISIT.2000.866791
Publication status	Published - 2000
Event	2000 IEEE International Symposium on Information Theory - Sorrento Palace Hotel Conference Centre, Sorrento, Italy Duration: 25 Jun 2000 → 30 Jun 2000

Conference

Conference	2000 IEEE International Symposium on Information Theory
Country/Territory	Italy
City	Sorrento
Period	25/06/00 → 30/06/00

Keywords

information processing
control systems
data processing theorem

Documents and Links

10.1109/ISIT.2000.866791

Cite this

@inproceedings{1acc7b882a384a5f928c255dd94ff8fe,

title = "Toward a theory of information processing",

abstract = "Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.",

keywords = "information processing, control systems, data processing theorem",

author = "S Sinanovic and Johnson, {D H}",

year = "2000",

doi = "10.1109/ISIT.2000.866791",

language = "English",

isbn = "0-7803-5857-0",

booktitle = "Proceedings of the IEEE International Symposium on Information Theory",

publisher = "IEEE",

note = "2000 IEEE International Symposium on Information Theory ; Conference date: 25-06-2000 Through 30-06-2000",

}

TY - GEN

T1 - Toward a theory of information processing

AU - Sinanovic, S

AU - Johnson, D H

PY - 2000

Y1 - 2000

N2 - Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.

AB - Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.

KW - information processing

KW - control systems

KW - data processing theorem

U2 - 10.1109/ISIT.2000.866791

DO - 10.1109/ISIT.2000.866791

M3 - Conference contribution

SN - 0-7803-5857-0

BT - Proceedings of the IEEE International Symposium on Information Theory

PB - IEEE

T2 - 2000 IEEE International Symposium on Information Theory

Y2 - 25 June 2000 through 30 June 2000

ER -