Kaplan–Meier estimator

An example of a Kaplan–Meier plot for two conditions associated with patient survival.

The Kaplan–Meier estimator,[1][2] also known as the product limit estimator, is a non-parametric statistic used to estimate the survival function from lifetime data. In medical research, it is often used to measure the fraction of patients living for a certain amount of time after treatment. In other fields, Kaplan–Meier estimators may be used to measure the length of time people remain unemployed after a job loss,[3] the time-to-failure of machine parts, or how long fleshy fruits remain on plants before they are removed by frugivores. The estimator is named after Edward L. Kaplan and Paul Meier, who each submitted similar manuscripts to the Journal of the American Statistical Association.[4] The journal editor, John Tukey, convinced them to combine their work into one paper, which has been cited more than 34,000 times since its publication in 1958.[5][6]

The estimator of the survival function (the probability that life is longer than ) is given by:

with a time when at least one event happened, di the number of events (e.g., deaths) that happened at time , and the individuals known to have survived (have not yet had an event or been censored) up to time .

Basic concepts

A plot of the Kaplan–Meier estimator is a series of declining horizontal steps which, with a large enough sample size, approaches the true survival function for that population. The value of the survival function between successive distinct sampled observations ("clicks") is assumed to be constant.

An important advantage of the Kaplan–Meier curve is that the method can take into account some types of censored data, particularly right-censoring, which occurs if a patient withdraws from a study, is lost to follow-up, or is alive without event occurrence at last follow-up. On the plot, small vertical tick-marks state individual patients whose survival times have been right-censored. When no truncation or censoring occurs, the Kaplan–Meier curve is the complement of the empirical distribution function.

In medical statistics, a typical application might involve grouping patients into categories, for instance, those with Gene A profile and those with Gene B profile. In the graph, patients with Gene B die much quicker than those with Gene A. After two years, about 80% of the Gene A patients survive, but less than half of patients with Gene B.

To generate a Kaplan–Meier estimator, at least two pieces of data are required for each patient (or each subject): the status at last observation (event occurrence or right-censored), and the time to event (or time to censoring). If the survival functions between two or more groups are to be compared, then a third piece of data is required: the group assignment of each subject.[7]

Problem definition

Let be a random variable as the time that passes between the start of the possible exposure period, , and the time that the event of interest takes place, . As indicated above, the goal is to estimate the survival function underlying . Recall that this function is defined as

, where is the time.

Let be independent, identically distributed random variables, whose common distribution is that of : is the random time when some event happened. The data available for estimating is not , but the list of pairs where for , is a fixed, deterministic integer, the censoring time of event and . In particular, the information available about the timing of event is whether the event happened before the fixed time and if so, then the actual time of the event is also available. The challenge is to estimate given this data.

Derivation of the Kaplan–Meier estimator

Two derivations of the Kaplan–Meier estimator are shown. Both are based on rewriting the survival function in terms of what is sometimes called hazard, or mortality rates. However, before doing this it is worthwhile to consider a naive estimator.

A naive estimator

To understand the power of the Kaplan–Meier estimator, it is worthwhile to first describe a naive estimator of the survival function.

Fix and let . A basic argument shows that the following proposition holds:

Proposition 1: If the censoring time of event exceeds (), then if and only if .

Let be such that . It follows from the above proposition that

Let and consider only those , i.e. the events for which the outcome was not censored before time . Let be the number of elements in . Note that the set is not random and so neither is . Furthermore, is a sequence of independent, identically distributed Bernoulli random variables with common parameter . Assuming that , this suggests to estimate using

where the second equality follows because implies , while the last equality is simply a change of notation.

The quality of this estimate is governed by the size of . This can be problematic when is small, which happens, by definition, when a lot of the events are censored. A particularly unpleasant property of this estimator, that suggests that perhaps it is not the "best" estimator, is that it ignores all the observations whose censoring time precedes . Intuitively, these observations still contain information about : For example, when for many events with , also holds, we can infer that events often happen early, which implies that is large, which, through means that must be small. However, this information is ignored by this naive estimator. The question is then whether there exists an estimator that makes a better use of all the data. This is what the Kaplan–Meier estimator accomplishes. Note that the naive estimator cannot be improved when censoring does not take place; so whether an improvement is possible critically hinges upon whether censoring is in place.

The plug-in approach

By elementary calculations,

where the second to last equality used that is integer valued and for the last line we introduced

By a recursive expansion of the equality , we get

Note that here .

The Kaplan–Meier estimator can be seen as a "plug-in estimator" where each is estimated based on the data and the estimator of is obtained as a product of these estimates.

It remains to specify how is to be estimated. By Proposition 1, for any such that , and both hold. Hence, for any such that ,

By a similar reasoning that lead to the construction of the naive estimator above, we arrive at the estimator

(think of estimating the numerator and denominator separately in the definition of the "hazard rate" ). The Kaplan–Meier estimator is then given by

The form of the estimator stated at the beginning of the article can be obtained by some further algebra. For this, write where, using the actuarial science terminology, is the number of known deaths at time , while is the number of those persons who are alive (and not being censored) at time .

Note that if , . This implies that we can leave out from the product defining all those terms where . Then, letting be the times when , and , we arrive at the form of the Kaplan–Meier estimator given at the beginning of the article:

As opposed to the naive estimator, this estimator can be seen to use the available information more effectively: In the special case mentioned beforehand, when there are many early events recorded, the estimator will multiply many terms with a value below one and will thus take into account that the survival probability cannot be large.

Derivation as a maximum likelihood estimator

Kaplan–Meier estimator can be derived from maximum likelihood estimation of the discrete hazard function.[8][self-published source?] More specifically given as the number of events and the total individuals at risk at time , discrete hazard rate can be defined as the probability of an individual with an event at time . Then survival rate can be defined as:

and the likelihood function for the hazard function up to time is:

therefore the log likelihood will be:

finding the maximum of log likelihood with respect to yields:

where hat is used to denote maximum likelihood estimation. Given this result, we can write:

More generally (for continuous as well as discrete survival distributions), the Kaplan-Meier estimator may be interpreted as a nonparametric maximum likelihood estimator.[9]

Benefits and limitations

The Kaplan–Meier estimator is one of the most frequently used methods of survival analysis. The estimate may be useful to examine recovery rates, the probability of death, and the effectiveness of treatment. It is limited in its ability to estimate survival adjusted for covariates; parametric survival models and the Cox proportional hazards model may be useful to estimate covariate-adjusted survival.

The Kaplan-Meier estimator is directly related to the Nelson-Aalen estimator and both maximize the empirical likelihood.[10]

Statistical considerations

The Kaplan–Meier estimator is a statistic, and several estimators are used to approximate its variance. One of the most common estimators is Greenwood's formula:[11]

where is the number of cases and is the total number of observations, for .

For a 'sketch' of the mathematical derivation of the equation above, click on "show" to reveal

Greenwood's formula is derived[12][self-published source?] by noting that probability of getting failures out of cases follows a binomial distribution with failure probability . As a result for maximum likelihood hazard rate we have and . To avoid dealing with multiplicative probabilities we compute variance of logarithm of and will use the delta method to convert it back to the original variance:

using martingale central limit theorem, it can be shown that the variance of the sum in the following equation is equal to the sum of variances:[12]

as a result we can write:

using the delta method once more:

as desired.


In some cases, one may wish to compare different Kaplan–Meier curves. This can be done by the log rank test, and the Cox proportional hazards test.

Other statistics that may be of use with this estimator are pointwise confidence intervals,[13] the Hall-Wellner band[14] and the equal-precision band.[15]

Software

  • Mathematica: the built-in function SurvivalModelFit creates survival models.[16]
  • SAS: The Kaplan–Meier estimator is implemented in the proc lifetest procedure.[17]
  • R: the Kaplan–Meier estimator is available as part of the survival package.[18][19][20]
  • Stata: the command sts returns the Kaplan–Meier estimator.[21][22]
  • Python: the lifelines and scikit-survival packages each include the Kaplan–Meier estimator.[23][24]
  • MATLAB: the ecdf function with the 'function','survivor' arguments can calculate or plot the Kaplan–Meier estimator.[25]
  • StatsDirect: The Kaplan–Meier estimator is implemented in the Survival Analysis menu.[26]
  • SPSS: The Kaplan–Meier estimator is implemented in the Analyze > Survival > Kaplan-Meier... menu.[27]
  • Julia: the Survival.jl package includes the Kaplan–Meier estimator.[28]
  • Epi Info: Kaplan–Meier estimator survival curves and results for the log rank test are obtained with the KMSURVIVAL command.[29]

See also

References

  1. ^ Kaplan, E. L.; Meier, P. (1958). "Nonparametric estimation from incomplete observations". J. Amer. Statist. Assoc. 53 (282): 457–481. doi:10.2307/2281868. JSTOR 2281868.
  2. ^ Kaplan, E.L. in a retrospective on the seminal paper in "This week's citation classic". Current Contents 24, 14 (1983). Available from UPenn as PDF.
  3. ^ Meyer, Bruce D. (1990). "Unemployment Insurance and Unemployment Spells" (PDF). Econometrica. 58 (4): 757–782. doi:10.2307/2938349. JSTOR 2938349. S2CID 154632727.
  4. ^ Stalpers, Lukas J A; Kaplan, Edward L (May 4, 2018). "Edward L. Kaplan and the Kaplan-Meier Survival Curve". BSHM Bulletin: Journal of the British Society for the History of Mathematics. 33 (2): 109–135. doi:10.1080/17498430.2018.1450055. S2CID 125941631.
  5. ^ Kaplan, E. L.; Meier, Paul (1958). "Nonparametric Estimation from Incomplete Observations". Journal of the American Statistical Association. 53 (282): 457–481. doi:10.1080/01621459.1958.10501452. Retrieved February 27, 2023.
  6. ^ "Paul Meier, 1924–2011". Chicago Tribune. August 18, 2011. Archived from the original on September 13, 2017.
  7. ^ Rich, Jason T.; Neely, J. Gail; Paniello, Randal C.; Voelker, Courtney C. J.; Nussenbaum, Brian; Wang, Eric W. (September 2010). "A practical guide to understanding Kaplan-Meier curves". Otolaryngology–Head and Neck Surgery. 143 (3): 331–336. doi:10.1016/j.otohns.2010.05.007. PMC 3932959. PMID 20723767.
  8. ^ "STAT331 Unit 3" (PDF). Retrieved May 12, 2023.
  9. ^ Andersen, Per Kragh; Borgan, Ornulf; Gill, Richard D.; Keiding, Niels (1993). Statistical models based on counting processes. New York: Springer-Verlag. ISBN 0-387-97872-0.
  10. ^ Zhou, M. (2015). Empirical Likelihood Method in Survival Analysis (1st ed.). Chapman and Hall/CRC. https://doi.org/10.1201/b18598, https://books.google.com/books?id=9-b5CQAAQBAJ&dq=Does+the+Nelson%E2%80%93Aalen+estimator+construct+an+empirical+likelihood%3F&pg=PA7
  11. ^ Greenwood, Major (1926). A report on the natural duration of cancer. Issue 33 of Reports on public health and medical subjects. HMSO. OCLC 14713088.
  12. ^ a b "The Greenwood and Exponential Greenwood Confidence Intervals in Survival Analysis" (PDF). Retrieved May 12, 2023.
  13. ^ Fay, Michael P.; Brittain, Erica H.; Proschan, Michael A. (September 1, 2013). "Pointwise confidence intervals for a survival distribution with small samples or heavy censoring". Biostatistics. 14 (4): 723–736. doi:10.1093/biostatistics/kxt016. PMC 3769999. PMID 23632624.
  14. ^ Hall, W. J.; Wellner, Jon A. (1980). "Confidence bands for a survival curve from censored data". Biometrika. 67 (1): 133–143. doi:10.1093/biomet/67.1.133.
  15. ^ Nair, Vijayan N. (August 1984). "Confidence Bands for Survival Functions With Censored Data: A Comparative Study". Technometrics. 26 (3): 265–275. doi:10.1080/00401706.1984.10487964.
  16. ^ "Survival Analysis – Mathematica SurvivalModelFit". wolfram.com. Retrieved August 14, 2017.
  17. ^ "SAS/STAT(R) 14.1 User's Guide". support.sas.com. Retrieved May 12, 2023.
  18. ^ Therneau, Terry M. (August 9, 2022). "survival: Survival Analysis". The Comprehensive R Archive Network. Retrieved November 30, 2022.
  19. ^ Willekens, Frans (2014). "Statistical Packages for Multistate Life History Analysis". Multistate Analysis of Life Histories with R. Use R!. Springer. pp. 135–153. doi:10.1007/978-3-319-08383-4_6. ISBN 978-3-319-08383-4.
  20. ^ Chen, Ding-Geng; Peace, Karl E. (2014). Clinical Trial Data Analysis Using R. CRC Press. pp. 99–108. ISBN 9781439840214.
  21. ^ "sts — Generate, graph, list, and test the survivor and cumulative hazard functions" (PDF). Stata Manual.
  22. ^ Cleves, Mario (2008). An Introduction to Survival Analysis Using Stata (Second ed.). College Station: Stata Press. pp. 93–107. ISBN 978-1-59718-041-2.
  23. ^ "lifelines — lifelines 0.27.7 documentation". lifelines.readthedocs.io. Retrieved May 12, 2023.
  24. ^ "sksurv.nonparametric.kaplan_meier_estimator — scikit-survival 0.20.0". scikit-survival.readthedocs.io. Retrieved May 12, 2023.
  25. ^ "Empirical cumulative distribution function – MATLAB ecdf". mathworks.com. Retrieved June 16, 2016.
  26. ^ "Kaplan-Meier Survival Estimates". statsdirect.co.uk. Retrieved May 12, 2023.
  27. ^ "Kaplan-Meier method in SPSS Statistics | Laerd Statistics".
  28. ^ "Kaplan-Meier · Survival.jl".
  29. ^ "Epi Info™ User Guide - Command Reference - Analysis Commands: KMSURVIVAL". Retrieved October 30, 2023.

Further reading

 Nota: Se foi redirecionado(a) para esta página e não é a que procura, consulte: Atlântico (desambiguação). Este artigo cita fontes, mas que não cobrem todo o conteúdo. Ajude a inserir referências. Conteúdo não verificável pode ser removido.—Encontre fontes: ABW  • CAPES  • Google (N • L • A) (Maio de 2013) Coordenadas: 7° n. Br., 31° w. L. Oceano AtlânticoO oceano Atlântico, dividido em Norte e Sul pela...

 

 

Document appointing an individual as an officer A commission is a formal document issued to appoint a named person to high office or as a commissioned officer in a territory's armed forces. A commission constitutes documentary authority that the person named is vested with the powers of that office and is empowered to execute official acts.[1] A commission often takes the form of letters patent. Commissions are typically issued in the name of or signed by the head of state. In Commonw...

 

 

Bupati PurwakartaPetahanaAnne Ratna Mustikasejak 20 September 2018Masa jabatan5 TahunPejabat pertamaRH Sunaryo Ronggowaluyo Berikut adalah Daftar Bupati Purwakarta dari masa ke masa. No Bupati Dari Sampai PartaiPolitik Masa Wakil Bupati 1 RH Sunaryo Ronggowaluyo 1968 1969 1(1968) - 2 RA Muchtar 1969 1979 2(1973) 3 (1978) 3 RHA Abubakar 1979 1980 Militer 4 Mukdas Dasuki 1980 1982 Militer (3) RHA Abubakar 1982 1983 Militer 5 Soedarna TM 1983 1993 Militer 4 (1983) 5 (1988) 6 Bunyamin Dudih&...

 

 

2023 World Wonder Ring Stardom professional wrestling event Stardom Supreme FightPromotional poster of the event featuring Giulia and Suzu SuzukiPromotionWorld Wonder Ring StardomDateFebruary 4, 2023CityOsaka, JapanVenueOsaka Prefectural GymnasiumAttendance1,832[1]Event chronology ← PreviousNew Blood 7 Next →Stardom in Showcase vol.4 Supreme Fight chronology ← PreviousNagoya Supreme Fight Next →- Stardom Supreme Fight 2023 (スターダム-スプリーム-フ

 

 

Election in New Hampshire Main article: 2020 United States presidential election 2020 United States presidential election in New Hampshire ← 2016 November 3, 2020 2024 → Turnout73.5% [1]   Nominee Joe Biden Donald Trump Party Democratic Republican Home state Delaware Florida Running mate Kamala Harris Mike Pence Electoral vote 4 0 Popular vote 424,921 365,654 Percentage 52.71% 45.36% County results Municipality results Precinct results Bi...

 

 

Відносини Узбекистан — НАТО Узбекистан НАТО НАТО і Узбекистан активно розвивають практичну співпрацю. Узбекистан бере участь в засіданнях Ради євроатлантичного партнерства та дискусіях з членами НАТО і країнами-партнерами. Співпраця з оборонних питань проходить в ра�...

 

 

Breton nationalist and Axis collaborator Célestin LainéCélestin Lainé in 1944Native nameNeven HénaffBorn1908NantesDied1983 (aged 74–75)IrelandAllegianceBretonService/branchMilitiaCommands heldBezen PerrotBattles/warsSecond World WarAlma materÉcole Centrale ParisOther workChemical engineer Célestin Lainé (1908–1983) was a Breton nationalist and collaborator during the Second World War who led the SS affiliated Bezen Perrot militia. His Breton language name is Neve...

 

 

2011 Italian film Alien ExorcismFilm posterItalian6 Giorni sulla Terra Directed byVaro VenturiWritten byVaro VenturiM. Luisa FusconiGiacomo MondadoriStarringMassimo PoggioLaura GlavanMarina KazankovaLudovico FremontCinematographyDaniele BaldacciEdited byVaro VenturiMusic byReinhold HeilJohnny KlimekJordan BalagotDistributed byBolero FilmRelease date 17 June 2011 (2011-06-17) (Italy) Running time101 minutesCountryItalyLanguageItalian Alien Exorcism (Italian: 6 Giorni sulla T...

 

 

Bài này viết về ngôn ngữ lập trình. Đối với các định nghĩa khác, xem Ruby (định hướng). Đừng nhầm lẫn với Ruby on Rails. RubyMẫu hìnhMulti-paradigm: Object-oriented, imperative, functional, reflectiveThiết kế bởiMatsumoto YukihiroNhà phát triểnMatsumoto Yukihiro, et al.Xuất hiện lần đầu1995; 28 năm trước (1995)Phiên bản ổn định2.4.0 / 25 tháng 12 năm 2016; 6 năm trước (2016-12-25)...

 

 

Waterfall in Mount Robson Provincial Park, British Columbia, Canada Overlander FallsOverlander FallsLocationMount Robson Provincial Park, British Columbia, CanadaCoordinates53°02′00″N 119°12′00″W / 53.03333°N 119.20000°W / 53.03333; -119.20000TypeBlockTotal height9 m (30 ft) [1]Number of drops1Total width23 m (75 ft)[1]Average width18 m (59 ft)[1]WatercourseFraser RiverAverageflow rate79 m3/s (2,800...

 

 

This article is about the German World War II commander. For the Austrian footballer, see Karl Decker (footballer). This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Karl Decker – news · newspapers · books · scholar · JSTOR (June 2016) (Learn how and when to remove this template message) Karl DeckerBorn(1897-1...

 

 

2018 American filmCanal StreetFilm posterDirected byRhyan LaMarrWritten by Adam Key John Knitter Rhyan LaMar Produced by Amir Windom Christopher Jennings Eric Garnes Rhyan LaMarr Kevin Mullens Starring Bryshere Y. Gray Mykelti Williamson Mekhi Phifer Kevin Quinn Woody McClain Lance Reddick CinematographyNicholas M. PuetzEdited byDavid C. KeithMusic by Amir Windom (music supervisor) Gretchen Yanover Michael “Wave” Lane Kevin “Khao” Cates Gary Windom Rhyan LaMarr Productioncompanies Red...

 

 

Artikel ini tidak memiliki referensi atau sumber tepercaya sehingga isinya tidak bisa dipastikan. Tolong bantu perbaiki artikel ini dengan menambahkan referensi yang layak. Tulisan tanpa sumber dapat dipertanyakan dan dihapus sewaktu-waktu.Cari sumber: Kayutrejo, Widodaren, Ngawi – berita · surat kabar · buku · cendekiawan · JSTOR KayutrejoDesaNegara IndonesiaProvinsiJawa TimurKabupatenNgawiKecamatanWidodarenKode pos63256Kode Kemendagri35.21.12.20...

 

 

This article is an orphan, as no other articles link to it. Please introduce links to this page from related articles; try the Find link tool for suggestions. (January 2019) 2011 video gameRobot Wants KittyDeveloper(s)Hamumu SoftwarePublisher(s)RaptisoftPlatform(s)iOSAndroidReleaseWW: March 18, 2011Genre(s)Platform-adventure, Metroidvania[1]Mode(s)Single-player Robot Wants Kitty is a 2011 action-adventure platform game developed by American indie developer Hamumu Software. It was adap...

 

 

German two-seat glider, 1979 ASK 21 Schleicher ASK 21 Role Two Seater-class or Club-class sailplaneType of aircraft National origin Germany Manufacturer Alexander Schleicher GmbH & Co Designer Rudolf Kaiser First flight February 1979 Introduction 1979 Number built Over 1000 The ASK 21 is a glass-reinforced plastic (GRP) two-seat glider aircraft with a T-tail. The ASK 21 is designed primarily for beginner instruction, but is also suitable for cross-country flying and aerobatic instruction....

 

 

スピリチュアリティ 関連記事 宗教 宗教の歴史 宗教の年表 伝統 キリスト教神秘主義 神秘主義カトリックの霊性(英語版) 現代 SBNR シンクレティズム新宗教 仏教モダニズム(英語版) 実践 神秘体験 秘教 エクスタシー霊的実践(英語版)祈り 秘蹟 瞑想 チャント 献身 慈善断食 不淫 キリスト教の瞑想(英語版)苦行 修道生活(英語版)レクティオ・ディヴィナ(英�...

 

 

English academic journal Academic journalBritish Journal of PharmacologyDisciplinePharmacologyLanguageEnglishEdited byPéter FerdinandyPublication detailsFormer name(s)British Journal of Pharmacology and ChemotherapyHistory1946–presentPublisherWiley-Blackwell on behalf of the British Pharmacological Society (United Kingdom)FrequencyBi-monthlyOpen accessHybrid, delayed (after 12 months)Impact factor9.473 (2021)Standard abbreviationsISO 4 (alt) · Bluebook (alt1 &#...

 

 

Russian male curler an curling coach Vasily TelezhkinCurlerBorn (1994-04-19) April 19, 1994 (age 29)Moscow, RussiaCurling career Member Association Russia Medal record Russian Men's Cup 2017 Vasily Telezhkin (Russian: Васи́лий Евге́ньевич Теле́жкин;[1] born April 19, 1994, in Moscow, Russia) is a Russian curler and curling coach from Moscow.[2] He is Master of Sports of Russia. Vasily is one of co-founders of not-professional curling devel...

 

 

1954 anthology film The BedFrenchSecrets d’alcôve ProductioncompaniesCormoran FilmsIndustrie Cinematografiche SocialiTerra Film ProduktionDistributed byTerrafilmGetz-KingsleyRelease date 21 May 1954 (1954-05-21) Running time86 minutesCountriesFranceItalyLanguageFrench You can help expand this article with text translated from the corresponding article in French. (January 2018) Click [show] for important translation instructions. Machine translation, like DeepL or Google...

 

 

هذه المقالة يتيمة إذ تصل إليها مقالات أخرى قليلة جدًا. فضلًا، ساعد بإضافة وصلة إليها في مقالات متعلقة بها. (أغسطس 2019) شجرة زائدية برؤوس زرقاء و أضلاع زائدية ملونه بالأصفر) وشجرة المضيف (أحمر) في الرياضيات، يُسمى الرسم الزائدي H {\displaystyle H} شجرة زائدية (hypertree ) إذا أمكن إيجاد رسم �...