Files in this item
Maximum likelihood thresholds via graph rigidity
Item metadata
dc.contributor.author | Bernstein, Daniel Irving | |
dc.contributor.author | Dewar, Sean | |
dc.contributor.author | Gortler, Steven J. | |
dc.contributor.author | Nixon, Anthony | |
dc.contributor.author | Sitharam, Meera | |
dc.contributor.author | Theran, Louis | |
dc.date.accessioned | 2024-07-09T12:30:07Z | |
dc.date.available | 2024-07-09T12:30:07Z | |
dc.date.issued | 2024-06-11 | |
dc.identifier | 297283484 | |
dc.identifier | c9fe0c98-0c1b-4e32-88cf-6c7a34ee0907 | |
dc.identifier.citation | Bernstein , D I , Dewar , S , Gortler , S J , Nixon , A , Sitharam , M & Theran , L 2024 , ' Maximum likelihood thresholds via graph rigidity ' , The Annals of Applied Probability , vol. 34 , no. 3 , pp. 3288-3319 . | en |
dc.identifier.issn | 1050-5164 | |
dc.identifier.other | ArXiv: http://arxiv.org/abs/2108.02185v3 | |
dc.identifier.other | ORCID: /0000-0001-5282-4800/work/163570817 | |
dc.identifier.uri | https://hdl.handle.net/10023/30124 | |
dc.description | DIB was partially supported by a Mathematical Sciences Postdoctoral Research Fellowship from the US NSF Grant DMS-1802902. SD was partially supported by the Austrian Science Fund (FWF): P31888. AN was partially supported by the Heilbronn Institute for Mathematical Research. SJG was partially supported by US NSF Grant DMS-1564473. MS was partially supported by US NSF Grant DMS-1564480 and US NSF Grant DMS-1563234. | en |
dc.description.abstract | The maximum likelihood threshold (MLT) of a graph G is the minimum number of samples to almost surely guarantee existence of the maximum likelihood estimate in the corresponding Gaussian graphical model. We give a new characterization of the MLT in terms of rigidity-theoretic properties of G and use this characterization to give new combinatorial lower bounds on the MLT of any graph. We use the new lower bounds to give high-probability guarantees on the maximum likelihood thresholds of sparse Erd{ö}s-Rényi random graphs in terms of their average density. These examples show that the new lower bounds are within a polylog factor of tight, where, on the same graph families, all known lower bounds are trivial. Based on computational experiments made possible by our methods, we conjecture that the MLT of an Erd{ö}s-Rényi random graph is equal to its generic completion rank with high probability. Using structural results on rigid graphs in low dimension, we can prove the conjecture for graphs with MLT at most 4 and describe the threshold probability for the MLT to switch from 3 to 4. We also give a geometric characterization of the MLT of a graph in terms of a new "lifting" problem for frameworks that is interesting in its own right. The lifting perspective yields a new connection between the weak MLT (where the maximum likelihood estimate exists only with positive probability) and the classical Hadwiger-Nelson problem. | |
dc.format.extent | 852130 | |
dc.language.iso | eng | |
dc.relation.ispartof | The Annals of Applied Probability | en |
dc.subject | Gaussian graphical models | en |
dc.subject | Number of observations | en |
dc.subject | Maximum likelihood threshold | en |
dc.subject | Combinatorial rigidity | en |
dc.subject | Algebraic statistics | en |
dc.subject | QA Mathematics | en |
dc.subject | T-NDAS | en |
dc.subject.lcc | QA | en |
dc.title | Maximum likelihood thresholds via graph rigidity | en |
dc.type | Journal article | en |
dc.contributor.institution | University of St Andrews. Centre for Interdisciplinary Research in Computational Algebra | en |
dc.contributor.institution | University of St Andrews. Pure Mathematics | en |
dc.description.status | Peer reviewed | en |
dc.date.embargoedUntil | 2024-07-09 | |
dc.identifier.url | https://arxiv.org/abs/2108.02185 | en |
This item appears in the following Collection(s)
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.