Toward a theory of information processing

S Sinanovic, D H Johnson

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.
    Original languageEnglish
    Title of host publicationProceedings of the IEEE International Symposium on Information Theory
    PublisherIEEE
    ISBN (Print)0-7803-5857-0
    DOIs
    Publication statusPublished - 2000

    Keywords

    • information processing
    • control systems
    • data processing theorem

    Cite this

    Sinanovic, S., & Johnson, D. H. (2000). Toward a theory of information processing. In Proceedings of the IEEE International Symposium on Information Theory IEEE. https://doi.org/10.1109/ISIT.2000.866791