Asymptotic rates of the information transfer ratio

Sinan Sinanovic, Don H. Johnson

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.
    Original languageEnglish
    Title of host publicationProceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing
    PublisherIEEE
    Pages1505-1508
    Number of pages4
    Volume2
    ISBN (Print) 0780374029
    DOIs
    Publication statusPublished - 13 May 2002

    Keywords

    • Markov processes
    • optimised production technology
    • Information processing
    • asymptotic rates

    Cite this

    Sinanovic, S., & Johnson, D. H. (2002). Asymptotic rates of the information transfer ratio. In Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing (Vol. 2, pp. 1505-1508). IEEE. https://doi.org/10.1109/ICASSP.2002.5744899
    Sinanovic, Sinan ; Johnson, Don H. / Asymptotic rates of the information transfer ratio. Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 2 IEEE, 2002. pp. 1505-1508
    @inproceedings{8d23e7f950ad460c998dd007621a2f1f,
    title = "Asymptotic rates of the information transfer ratio",
    abstract = "Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.",
    keywords = "Markov processes, optimised production technology, Information processing, asymptotic rates",
    author = "Sinan Sinanovic and Johnson, {Don H.}",
    year = "2002",
    month = "5",
    day = "13",
    doi = "10.1109/ICASSP.2002.5744899",
    language = "English",
    isbn = "0780374029",
    volume = "2",
    pages = "1505--1508",
    booktitle = "Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing",
    publisher = "IEEE",

    }

    Sinanovic, S & Johnson, DH 2002, Asymptotic rates of the information transfer ratio. in Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing. vol. 2, IEEE, pp. 1505-1508. https://doi.org/10.1109/ICASSP.2002.5744899

    Asymptotic rates of the information transfer ratio. / Sinanovic, Sinan; Johnson, Don H.

    Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 2 IEEE, 2002. p. 1505-1508.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    TY - GEN

    T1 - Asymptotic rates of the information transfer ratio

    AU - Sinanovic, Sinan

    AU - Johnson, Don H.

    PY - 2002/5/13

    Y1 - 2002/5/13

    N2 - Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.

    AB - Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.

    KW - Markov processes

    KW - optimised production technology

    KW - Information processing

    KW - asymptotic rates

    U2 - 10.1109/ICASSP.2002.5744899

    DO - 10.1109/ICASSP.2002.5744899

    M3 - Conference contribution

    SN - 0780374029

    VL - 2

    SP - 1505

    EP - 1508

    BT - Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing

    PB - IEEE

    ER -

    Sinanovic S, Johnson DH. Asymptotic rates of the information transfer ratio. In Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 2. IEEE. 2002. p. 1505-1508 https://doi.org/10.1109/ICASSP.2002.5744899