Asymptotic rates of the information transfer ratio

Sinan Sinanovic; Don H. Johnson

doi:10.1109/ICASSP.2002.5744899

Asymptotic rates of the information transfer ratio

Sinan Sinanovic
, Don H. Johnson

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.

Original language	English
Title of host publication	Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing
Publisher	IEEE
Pages	1505-1508
Number of pages	4
Volume	2
ISBN (Print)	0780374029
DOIs	https://doi.org/10.1109/ICASSP.2002.5744899
Publication status	Published - 13 May 2002
Event	2002 IEEE International Conference on Acoustics, Speech, and Signal Processing - Renaissance Orlando Resort, Orlando, United States Duration: 13 May 2002 → 17 May 2002 http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=5743986

Conference

Conference	2002 IEEE International Conference on Acoustics, Speech, and Signal Processing
Abbreviated title	ICASSP 2002
Country/Territory	United States
City	Orlando
Period	13/05/02 → 17/05/02
Internet address	http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=5743986

Keywords

Markov processes
optimised production technology
Information processing
asymptotic rates

Documents and Links

10.1109/ICASSP.2002.5744899

Cite this

@inproceedings{8d23e7f950ad460c998dd007621a2f1f,

title = "Asymptotic rates of the information transfer ratio",

abstract = "Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.",

keywords = "Markov processes, optimised production technology, Information processing, asymptotic rates",

author = "Sinan Sinanovic and Johnson, \{Don H.\}",

year = "2002",

month = may,

day = "13",

doi = "10.1109/ICASSP.2002.5744899",

language = "English",

isbn = " 0780374029",

volume = "2",

pages = "1505--1508",

booktitle = "Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing",

publisher = "IEEE",

address = "United States",

note = "2002 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2002 ; Conference date: 13-05-2002 Through 17-05-2002",

url = "http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=5743986",

}

Sinanovic, S & Johnson, DH 2002, Asymptotic rates of the information transfer ratio. in Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing. vol. 2, IEEE, pp. 1505-1508, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing, Orlando, Florida, United States, 13/05/02. https://doi.org/10.1109/ICASSP.2002.5744899

TY - GEN

T1 - Asymptotic rates of the information transfer ratio

AU - Sinanovic, Sinan

AU - Johnson, Don H.

PY - 2002/5/13

Y1 - 2002/5/13

N2 - Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.

AB - Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information, Kullback-Leibler distance, information-theoretic measure that reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.

KW - Markov processes

KW - optimised production technology

KW - Information processing

KW - asymptotic rates

U2 - 10.1109/ICASSP.2002.5744899

DO - 10.1109/ICASSP.2002.5744899

M3 - Conference contribution

SN - 0780374029

VL - 2

SP - 1505

EP - 1508

BT - Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing

PB - IEEE

T2 - 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing

Y2 - 13 May 2002 through 17 May 2002

ER -

Asymptotic rates of the information transfer ratio

Abstract

Conference

Keywords

Documents and Links

Fingerprint

Cite this