Files in this item
Bayesian bin distribution inference and mutual information
Item metadata
dc.contributor.author | Endres, Dominik Maria | |
dc.contributor.author | Foldiak, Peter | |
dc.date.accessioned | 2010-12-02T14:18:57Z | |
dc.date.available | 2010-12-02T14:18:57Z | |
dc.date.issued | 2005-11 | |
dc.identifier.citation | Endres , D M & Foldiak , P 2005 , ' Bayesian bin distribution inference and mutual information ' , IEEE Transactions on Information Theory , vol. 51 , no. 11 , pp. 3766-3779 . https://doi.org/10.1109/TIT.2005.856954 | en |
dc.identifier.issn | 0018-9448 | |
dc.identifier.other | PURE: 293246 | |
dc.identifier.other | PURE UUID: 1188bdc6-6ab4-4e3c-b225-e09fd3c13354 | |
dc.identifier.other | WOS: 000233047800006 | |
dc.identifier.other | Scopus: 27744440784 | |
dc.identifier.uri | https://hdl.handle.net/10023/1592 | |
dc.description.abstract | We present an exact Bayesian treatment of a simple, yet sufficiently general probability distribution model. We consider piecewise-constant distributions' P(X) with uniform (second-order) prior over location of discontinuity points and assigned chances. The predictive distribution and the model complexity can be determined completely from the data in a computational time that is linear in the number of degrees of freedom and quadratic in the number of possible values of X. Furthermore, exact values of the expectations of entropies and their variances can be computed with polynomial effort. The expectation of the mutual information becomes thus available, too, and a strict upper bound on its variance. The resulting algorithm is particularly useful in experimental research areas where the number of available samples is severely limited (e.g., neurophysiology). Estimates on a simulated data set provide more accurate results than using a previously proposed method. | |
dc.format.extent | 14 | |
dc.language.iso | eng | |
dc.relation.ispartof | IEEE Transactions on Information Theory | en |
dc.rights | (c) 2005 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works | en |
dc.subject | Bayesian inference | en |
dc.subject | Entropy | en |
dc.subject | Model selection | en |
dc.subject | Mutual information | en |
dc.subject | QA Mathematics | en |
dc.subject.lcc | QA | en |
dc.title | Bayesian bin distribution inference and mutual information | en |
dc.type | Journal article | en |
dc.description.version | Publisher PDF | en |
dc.contributor.institution | University of St Andrews. School of Psychology and Neuroscience | en |
dc.identifier.doi | https://doi.org/10.1109/TIT.2005.856954 | |
dc.description.status | Peer reviewed | en |
dc.identifier.url | http://www.scopus.com/inward/record.url?scp=27744440784&partnerID=8YFLogxK | en |
This item appears in the following Collection(s)
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.