Inverse-Wishart distribution

Inverse-Wishart
Notation
Parameters degrees of freedom (real)
, scale matrix (pos. def.)
Support is p × p positive definite
PDF

Mean For
Mode [1]: 406 
Variance see below

In statistics, the inverse Wishart distribution, also called the inverted Wishart distribution, is a probability distribution defined on real-valued positive-definite matrices. In Bayesian statistics it is used as the conjugate prior for the covariance matrix of a multivariate normal distribution.

We say follows an inverse Wishart distribution, denoted as , if its inverse has a Wishart distribution . Important identities have been derived for the inverse-Wishart distribution.[2]

Density

The probability density function of the inverse Wishart is:[3]

where and are positive definite matrices, is the determinant, and is the multivariate gamma function.

Theorems

Distribution of the inverse of a Wishart-distributed matrix

If and is of size , then has an inverse Wishart distribution .[4]

Marginal and conditional distributions from an inverse Wishart-distributed matrix

Suppose has an inverse Wishart distribution. Partition the matrices and conformably with each other

where and are matrices, then we have

  1. is independent of and , where is the Schur complement of in ;
  2. ;
  3. , where is a matrix normal distribution;
  4. , where ;

Conjugate distribution

Suppose we wish to make inference about a covariance matrix whose prior has a distribution. If the observations are independent p-variate Gaussian variables drawn from a distribution, then the conditional distribution has a distribution, where .

Because the prior and posterior distributions are the same family, we say the inverse Wishart distribution is conjugate to the multivariate Gaussian.

Due to its conjugacy to the multivariate Gaussian, it is possible to marginalize out (integrate out) the Gaussian's parameter , using the formula and the linear algebra identity :

(this is useful because the variance matrix is not known in practice, but because is known a priori, and can be obtained from the data, the right hand side can be evaluated directly). The inverse-Wishart distribution as a prior can be constructed via existing transferred prior knowledge.[5]

Moments

The following is based on Press, S. J. (1982) "Applied Multivariate Analysis", 2nd ed. (Dover Publications, New York), after reparameterizing the degree of freedom to be consistent with the p.d.f. definition above.

Let with and , so that .

The mean:[4]: 85 

The variance of each element of :

The variance of the diagonal uses the same formula as above with , which simplifies to:

The covariance of elements of are given by:

The same results are expressed in Kronecker product form by von Rosen[6] as follows:

where

commutation matrix

There appears to be a typo in the paper whereby the coefficient of is given as rather than , and that the expression for the mean square inverse Wishart, corollary 3.1, should read

To show how the interacting terms become sparse when the covariance is diagonal, let and introduce some arbitrary parameters :

where denotes the matrix vectorization operator. Then the second moment matrix becomes

which is non-zero only when involving the correlations of diagonal elements of , all other elements are mutually uncorrelated, though not necessarily statistically independent. The variances of the Wishart product are also obtained by Cook et al.[7] in the singular case and, by extension, to the full rank case.

Muirhead[8] shows in Theorem 3.2.8 that if is distributed as and is an arbitrary vector, independent of then and , one degree of freedom being relinquished by estimation of the sample mean in the latter. Similarly, Bodnar et.al. further find that and setting the marginal distribution of the leading diagonal element is thus

and by rotating end-around a similar result applies to all diagonal elements .

A corresponding result in the complex Wishart case was shown by Brennan and Reed[9] and the uncorrelated inverse complex Wishart was shown by Shaman[10] to have diagonal statistical structure in which the leading diagonal elements are correlated, while all other element are uncorrelated.

  • A univariate specialization of the inverse-Wishart distribution is the inverse-gamma distribution. With (i.e. univariate) and , and the probability density function of the inverse-Wishart distribution becomes matrix
i.e., the inverse-gamma distribution, where is the ordinary Gamma function.
  • The Inverse Wishart distribution is a special case of the inverse matrix gamma distribution when the shape parameter and the scale parameter .
  • Another generalization has been termed the generalized inverse Wishart distribution, . A positive definite matrix is said to be distributed as if is distributed as . Here denotes the symmetric matrix square root of , the parameters are positive definite matrices, and the parameter is a positive scalar larger than . Note that when is equal to an identity matrix, . This generalized inverse Wishart distribution has been applied to estimating the distributions of multivariate autoregressive processes.[11]
  • A different type of generalization is the normal-inverse-Wishart distribution, essentially the product of a multivariate normal distribution with an inverse Wishart distribution.
  • When the scale matrix is an identity matrix, , and is an arbitrary orthogonal matrix, replacement of by does not change the pdf of so belongs to the family of spherically invariant random processes (SIRPs) in some sense.[clarification needed]
Thus, an arbitrary p-vector with length can be rotated into the vector without changing the pdf of , moreover can be a permutation matrix which exchanges diagonal elements. It follows that the diagonal elements of are identically inverse chi squared distributed, with pdf in the previous section though they are not mutually independent. The result is known in optimal portfolio statistics, as in Theorem 2 Corollary 1 of Bodnar et al,[12] where it is expressed in the inverse form .
  • As is the case with the Wishart distribution linear transformations of the distribution yield a modified inverse Wishart distribution. If and are full rank matrices then[13]
  • If and is of full rank then[13]

See also

References

  1. ^ A. O'Hagan, and J. J. Forster (2004). Kendall's Advanced Theory of Statistics: Bayesian Inference. Vol. 2B (2 ed.). Arnold. ISBN 978-0-340-80752-1.
  2. ^ Haff, LR (1979). "An identity for the Wishart distribution with applications". Journal of Multivariate Analysis. 9 (4): 531–544. doi:10.1016/0047-259x(79)90056-3.
  3. ^ Gelman, Andrew; Carlin, John B.; Stern, Hal S.; Dunson, David B.; Vehtari, Aki; Rubin, Donald B. (2013-11-01). Bayesian Data Analysis, Third Edition (3rd ed.). Boca Raton: Chapman and Hall/CRC. ISBN 9781439840955.
  4. ^ a b Kanti V. Mardia, J. T. Kent and J. M. Bibby (1979). Multivariate Analysis. Academic Press. ISBN 978-0-12-471250-8.
  5. ^ Shahrokh Esfahani, Mohammad; Dougherty, Edward (2014). "Incorporation of Biological Pathway Knowledge in the Construction of Priors for Optimal Bayesian Classification". IEEE Transactions on Bioinformatics and Computational Biology. 11 (1): 202–218. doi:10.1109/tcbb.2013.143. PMID 26355519. S2CID 10096507.
  6. ^ Rosen, Dietrich von (1988). "Moments for the Inverted Wishart Distribution". Scand. J. Stat. 15: 97–109 – via JSTOR.
  7. ^ Cook, R D; Forzani, Liliana (August 2019). Cook, Brian (ed.). "On the mean and variance of the generalized inverse of a singular Wishart matrix". Electronic Journal of Statistics. 5. doi:10.4324/9780429344633. ISBN 9780429344633. S2CID 146200569.
  8. ^ Muirhead, Robb (1982). Aspects of Multivariate Statistical Theory. USA: Wiley. p. 93. ISBN 0-471-76985-1.
  9. ^ Brennan, L E; Reed, I S (January 1982). "An Adaptive Array Signal Processing Algorithm for Communications". IEEE Transactions on Aerospace and Electronic Systems. 18 (1): 120–130. Bibcode:1982ITAES..18..124B. doi:10.1109/TAES.1982.309212. S2CID 45721922.
  10. ^ Shaman, Paul (1980). "The Inverted Complex Wishart Distribution and Its Application to Spectral Estimation" (PDF). Journal of Multivariate Analysis. 10: 51–59. doi:10.1016/0047-259X(80)90081-0.
  11. ^ Triantafyllopoulos, K. (2011). "Real-time covariance estimation for the local level model". Journal of Time Series Analysis. 32 (2): 93–107. arXiv:1311.0634. doi:10.1111/j.1467-9892.2010.00686.x. S2CID 88512953.
  12. ^ Bodnar, T.; Mazur, S.; Podgórski, K. (January 2015). "Singular Inverse Wishart Distribution with Application to Portfolio Theory". Department of Statistics, Lund University. (Working Papers in Statistics, Nr. 2): 1–17.
  13. ^ a b Bodnar, T; Mazur, S; Podgorski, K (2015). "Singular Inverse Wishart Distribution with Application to Portfolio Theory". Journal of Multivariate Analysis. 143: 314–326. doi:10.1016/j.jmva.2015.09.021.

Read other articles:

Vương Thừa VũDeputy Chief of the PAVN General StaffIn office1964–1980Commander of Military Region 4In office1964–1971Preceded byĐàm Quang TrungSucceeded byĐàm Quang TrungCommander of Military Region 3In office1955–1963 Personal detailsBorn1910Vinh Ninh, Thuong Tin District, Hanoi, French IndochinaDied1980VietnamPolitical partyCommunist Party of VietnamChildren6Alma materWhampoa Military AcademyMilitary serviceAllegiance Kuomintang China (1930s) Democratic Republic of Vietnam an...

 

1964–1991 Soviet title of honour AwardHonorary titleHonoured Cultural Worker of the RSFSRA chest badge Honoured Cultural Worker of the RSFSRTypeHonorary titlePresented by RussiaEligibilityCitizens of the Russian Soviet Federative Socialist RepublicStatusNo longer awardedEstablishedMay 26,1964 Honoured Cultural Worker of the RSFSR (Russian: Заслуженный работник культуры РСФСР) was an honorary title given by the Russian Soviet Federative Socialist Republic...

 

Best of TimesPoster internasionalSutradara Yongyoot Thongkongtoon Produser Chenchonnee Soonthonsaratul Suwimol Techasupinan Yongyoot Thongkongtoon Ditulis oleh Nontra Kumwong Aummaraporn Phandintong Vanridee Pongsittisak SkenarioNontra KumwongAummaraporn Phandintong Vanridee PongsittisakPemeranArak Amornsupasiri Yarinda Bunnag Krissana Sreadthatamrong Sansanee WattananukulPenata musikTherdsak ChanpanSinematograferSomboon PhopitakkulPenyuntingPan BusabaanPerusahaanproduksiGTHTanggal rili...

Gunshi KanbeiDitulis olehYoichi MaekawaSutradaraKenji TanakaPemeranJunichi Okada Miki Nakatani Akira Terao Shōsuke Tanihara Tori Matsuzaka Yuki Uchida Toma Ikuta Shunpūtei Koasa Fumi Nikaidō Tetsushi Tanaka Mirei Kiritani Gaku Hamada Mokomichi Hayami Issei Takahashi Kei Tanaka Mitsuki Takahata Kazuhiro Yamaji Tsurutaro Kataoka Takanori Jinnai Shingo Tsurumi Masatō Ibu Hitomi Kuroki Yōsuke Eguchi Naoto Takenaka Kyōhei ShibataPenggubah lagu temaYugo KannoPenata musikYugo KannoNegara...

 

Fafe Linha(s): Linha de Guimarães (PK 80,585) Coordenadas: 41° 27′ 16,81″ N, 8° 10′ 15,85″ O Concelho:  Fafe Inauguração: 21 de julho de 1907 (há 116 anos) Encerramento: 1986 (há 36 anos) A Estação Ferroviária de Fafe foi uma interface da Linha de Guimarães, que servia a localidade de Fafe, no Distrito de Braga, em Portugal. Foi inaugurada em 21 de Julho de 1907,[1] e encerrada em 1986.[2] História Ver artigo principal: Linha de Guimarães § História ...

 

1919 Finnish presidential election 25 July 1919 1925 →   Candidate Kaarlo Juho Ståhlberg Carl Gustaf Emil Mannerheim Party National Progressive Independent Electoral vote 143 50 President before election Office established Elected President Kaarlo Juho Ståhlberg National Progressive The presidential election taking place. Indirect presidential elections were held for the first time in Finland in 1919.[1] Although the country had declared Prince Frederick Charles...

أليين الخواص الصيغة الجزيئية C₆H₁₁NO₃S  المعرفات CAS 556-27-4  بوب كيم 9576089  مواصفات الإدخال النصي المبسط للجزيئات C=CCS(=O)CC(C(=O)O)N[1]  المعرف الكيميائي الدولي InChI=1S/C6H11NO3S/c1-2-3-11(10)4-5(7)6(8)9/h2,5H,1,3-4,7H2,(H,8,9)/t5-,11-/m0/s1[1]  InChIKey:XUHLIQGRKRUKPH-DYEAUMGKSA-N[1][2]  في حال عدم ورود غير ذ...

 

American crime drama television series BMFOfficial logoGenreCrime dramaCreated byRandy HugginsStarring Demetrius Flenory Jr. Da'Vinchi Michole Briana White Eric Kofi-Abrefa Richard Slade Ajiona Alexus Myles Truitt Steve Harris La La Anthony Kelly Hu Russell Hornsby Opening themeWish Me Luck by 50 Cent and Charlie WilsonCountry of originUnited StatesOriginal languageEnglishNo. of seasons2No. of episodes18ProductionExecutive producers Curtis Jackson Randy Huggins Terri Kopp Anthony Wilson Anne ...

 

Untuk kegunaan lain, lihat Parang. Sebilah Parang Parang adalah pisau besar (lebih besar daripada pisau biasa, tetapi lebih pendek daripada pedang, ada bermacam-macam)[1] Parang terbuat dari besi yang ditempa, dengan satu sisi tajam, secara umum bilah parang berukuran cukup panjang yaitu 36-60 cm kadang lebih, dan ada juga jenis parang pendek ukuran bilah 25-35 cm. Bentuknya relatif sederhana tanpa pernak pernik, sebagian parang memiliki semacam penahan tangan pada gagang, sebagian pa...

1979 bomb attack in Mullaghmore, Ireland Assassination of Louis Mountbatten, 1st Earl Mountbatten of BurmaPart of The TroublesLocationMullaghmore Peninsula, IrelandCoordinates54°27′59″N 8°26′55″W / 54.4664°N 8.4486°W / 54.4664; -8.4486Date27 August 1979; 44 years ago (1979-08-27)TargetEarl MountbattenAttack typeBombingWeaponBombDeaths Earl Mountbatten Nicholas Knatchbull Paul Maxwell Doreen Knatchbull Injured Patricia Knatchbull John Knatc...

 

Chinese TV series or program The Golden EyesOfficial Promotional PosterAlso known asThe Golden PupilGenreAdventureFictionFantasyRomanceBased onThe Golden EyesWritten byDayanDirected byLin NanStarringLay ZhangWang ZixuanWang YuexinCountry of originChinaOriginal languageMandarinNo. of seasons1No. of episodes56ProductionExecutive producersBai Yicong Zhang YuanangProduction locationsChinaUkraineRunning time45 minutesProduction companiesiQiYi, Linghe Media TencentOriginal releaseNetworkiQiYiR...

 

Constituency of the Andhra Pradesh Legislative Assembly, India SullurpetaConstituency No. 121 for the Andhra Pradesh Legislative AssemblyLocation of Sullurpeta Assembly constituency within Andhra PradeshConstituency detailsCountryIndiaRegionSouth IndiaStateAndhra PradeshDistrictTirupatiLS constituencyTirupatiEstablished1962Total electors231,638ReservationSCMember of Legislative Assembly15th Andhra Pradesh Legislative AssemblyIncumbent Sanjeevaiah Kiliveti Party  YSRCPElected year201...

Andrew Viktor SchallySinh30 tháng 11 năm 1926 (97 tuổi)Wilno, Đệ nhị Cộng hòa Ba LanHọc vịĐại học McGillGiải thưởngGiải Albert Lasker cho nghiên cứu Y học cơ bản (1975) Giải Nobel Sinh lý và Y khoa (1977)Sự nghiệp khoa họcNơi công tácBaylor College of Medicine Đại học Tulane Đại học Miami Andrew Viktor Schally tên khai sinh là Andrzej Wiktor Schally, sinh ngày 30.11.1926, là nhà nội tiết học người Mỹ gốc Ba Lan,...

 

Japanese Indoligist (1930–2021) Minoru HARABorn(1930-09-09)9 September 1930Tokyo, JapanDied1 November 2021(2021-11-01) (aged 91)Other names原 實Occupation(s)WriterIndologistPhilologistScholarKnown forSanskrit and Buddhist literatureAwardsPadma Bhushan Minoru Hara (原 實, Hara Minoru, 9 September 1930 – 1 November 2021) was a Japanese writer, Indologist, philologist, and a scholar of Sanskrit and Buddhist literature and philosophy.[1] Biography Hara was a profess...

 

2004 studio album by Tsu Shi Ma Mi RePregnant FantasyStudio album by Tsu Shi Ma Mi ReReleasedAugust 25, 2004(Japan)November 1, 2005(North America)GenreArt punkLength32:50LabelBenten Label TokyoProducerNail/AllegroTsu Shi Ma Mi Re chronology Pregnant Fantasy(2004) Noumiso Shortcake(2007) Alternative coverNorth American cover Professional ratingsReview scoresSourceRatingTiny Mix Tapes [1] Pregnant Fantasy ( 創造妊娠 — Souzou Ninshin) is the debut album of the Japanese art ...

Archaic geographical term D'Anville's map of China proper and Chinese Tartary, created in 1734. Map of independent Tartary (in yellow) and Chinese Tartary (in violet), in 1806. Chinese Tartary (Chinese: 中國韃靼利亞; pinyin: Zhōngguó Dádálìyà) is an archaic geographical term referring to the regions of Manchuria, Mongolia, Xinjiang (also referred to as Chinese Turkestan), and Tibet under the rule of the Qing dynasty of China. The term Tartar was used by Europeans to refer ...

 

Drs. H.Muhammad Juaini TaofikM.A.P.Pj Bupati Lombok TimurPetahanaMulai menjabat 26 September 2023GubernurLalu Gita AriadiPendahuluM. Sukiman Azmy Informasi pribadiLahir13 Juni 1973 (umur 50)Lombok Timur, Nusa Tenggara Barat, IndonesiaKebangsaanIndonesiaAlma materInstitut Pemerintahan Dalam Negeri 1994Sunting kotak info • L • B Drs. H. Muhammad Juaini Taofik, M.AP. merupakan Birokrat lulusan Institut Pemerintahan Dalam Negeri 1994 yang sedang menjabat sebagai Sekretaris ...

 

Indian actress Mallika DuaDua in 2019Born (1989-07-18) 18 July 1989 (age 34)Delhi, IndiaNationalityIndianAlma materFranklin and Marshall CollegeOccupationsComedianActressWriterYears active2016–presentParentsVinod Dua (father)Padmavati Dua (mother) Mallika Dua (born 18 July 1989) is an Indian comedian, actress and writer. The comedian shot to fame with the viral video of Shit People Say: Sarojini Nagar Edition,[1] which was written, styled and enacted by Dua herself. S...

Indian actor This article is about the Indian actor. For the Canadian darts player, see Avtar Gill (darts player). Avtar GillGill in 2010Born (1950-05-14) May 14, 1950 (age 73)OccupationActorYears active1978-Present Avtar Gill (born May 14, 1950) is an Indian actor who appears predominantly in Hindi and Punjabi language 13 films and television serials. He has done many plays with Indian People's Theatre Association Mumbai.[1] Selected filmography Films Noorie (1979) Albert P...

 

Soviet footballer In this name that follows Eastern Slavic naming conventions, the patronymic is Fyodorovich and the family name is Sadyrin. Pavel Sadyrin Personal informationFull name Pavel Fyodorovich SadyrinDate of birth (1942-09-18)18 September 1942Place of birth Molotov, Soviet UnionDate of death 1 December 2001(2001-12-01) (aged 59)Place of death Moscow, RussiaHeight 1.73 m (5 ft 8 in)Position(s) MidfielderYouth career1956–1959 Zvezda PermSenior career*Years Te...

 

Strategi Solo vs Squad di Free Fire: Cara Menang Mudah!