Toward a theory of information processing

S. Sinanović*, D. H. Johnson

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.

Original languageEnglish
Title of host publication2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060)
Number of pages1
ISBN (Print)0780358570
Publication statusPublished - 6 Aug 2002
Externally publishedYes
Event2000 IEEE International Symposium on Information Theory - Sorrento Palace Hotel Conference Centre, Sorrento, Italy
Duration: 25 Jun 200030 Jun 2000

Publication series

NameIEEE International Symposium on Information Theory - Proceedings
ISSN (Print)2157-8095


Conference2000 IEEE International Symposium on Information Theory

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Information Systems
  • Modelling and Simulation
  • Applied Mathematics


Dive into the research topics of 'Toward a theory of information processing'. Together they form a unique fingerprint.

Cite this