Toward a theory of information processing

S Sinanovic, D H Johnson

    Research output: Chapter in Book/Report/Conference proceedingConference contribution


    Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system's fundamental information processing properties.
    Original languageEnglish
    Title of host publicationProceedings of the IEEE International Symposium on Information Theory
    ISBN (Print)0-7803-5857-0
    Publication statusPublished - 2000


    • information processing
    • control systems
    • data processing theorem

    Cite this