Toward a theory of information processing

S Sinanovic, D H Johnson

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.
    Original languageEnglish
    Title of host publicationProceedings of the IEEE International Symposium on Information Theory
    PublisherIEEE
    ISBN (Print)0-7803-5857-0
    DOIs
    Publication statusPublished - 2000
    Event2000 IEEE International Symposium on Information Theory - Sorrento Palace Hotel Conference Centre, Sorrento, Italy
    Duration: 25 Jun 200030 Jun 2000

    Conference

    Conference2000 IEEE International Symposium on Information Theory
    Country/TerritoryItaly
    CitySorrento
    Period25/06/0030/06/00

    Keywords

    • information processing
    • control systems
    • data processing theorem

    Cite this