Linear multistep method

Linear multistep methods are used for the numerical solution of ordinary differential equations. Conceptually, a numerical method starts from an initial point and then takes a short step forward in time to find the next solution point. The process continues with subsequent steps to map out the solution. Single-step methods (such as Euler's method) refer to only one previous point and its derivative to determine the current value. Methods such as Runge–Kutta take some intermediate steps (for example, a half-step) to obtain a higher order method, but then discard all previous information before taking a second step. Multistep methods attempt to gain efficiency by keeping and using the information from previous steps rather than discarding it. Consequently, multistep methods refer to several previous points and derivative values. In the case of linear multistep methods, a linear combination of the previous points and derivative values is used.

Definitions

Numerical methods for ordinary differential equations approximate solutions to initial value problems of the form

The result is approximations for the value of at discrete times : where is the time step (sometimes referred to as ) and is an integer.

Multistep methods use information from the previous steps to calculate the next value. In particular, a linear multistep method uses a linear combination of and to calculate the value of for the desired current step. Thus, a linear multistep method is a method of the form with . The coefficients and determine the method. The designer of the method chooses the coefficients, balancing the need to get a good approximation to the true solution against the desire to get a method that is easy to apply. Often, many coefficients are zero to simplify the method.

One can distinguish between explicit and implicit methods. If , then the method is called "explicit", since the formula can directly compute . If then the method is called "implicit", since the value of depends on the value of , and the equation must be solved for . Iterative methods such as Newton's method are often used to solve the implicit formula.

Sometimes an explicit multistep method is used to "predict" the value of . That value is then used in an implicit formula to "correct" the value. The result is a predictor–corrector method.

Examples

Consider for an example the problem The exact solution is .

One-step Euler

A simple numerical method is Euler's method: Euler's method can be viewed as an explicit multistep method for the degenerate case of one step.

This method, applied with step size on the problem , gives the following results:

Two-step Adams–Bashforth

Euler's method is a one-step method. A simple multistep method is the two-step Adams–Bashforth method This method needs two values, and , to compute the next value, . However, the initial value problem provides only one value, . One possibility to resolve this issue is to use the computed by Euler's method as the second value. With this choice, the Adams–Bashforth method yields (rounded to four digits): The exact solution at is , so the two-step Adams–Bashforth method is more accurate than Euler's method. This is always the case if the step size is small enough.

Families of multistep methods

Three families of linear multistep methods are commonly used: Adams–Bashforth methods, Adams–Moulton methods, and the backward differentiation formulas (BDFs).

Adams–Bashforth methods

The Adams–Bashforth methods are explicit methods. The coefficients are and , while the are chosen such that the methods have order s (this determines the methods uniquely).

The Adams–Bashforth methods with s = 1, 2, 3, 4, 5 are (Hairer, Nørsett & Wanner 1993, §III.1; Butcher 2003, p. 103):

The coefficients can be determined as follows. Use polynomial interpolation to find the polynomial p of degree such that The Lagrange formula for polynomial interpolation yields The polynomial p is locally a good approximation of the right-hand side of the differential equation that is to be solved, so consider the equation instead. This equation can be solved exactly; the solution is simply the integral of p. This suggests taking The Adams–Bashforth method arises when the formula for p is substituted. The coefficients turn out to be given by Replacing by its interpolant p incurs an error of order hs, and it follows that the s-step Adams–Bashforth method has indeed order s (Iserles 1996, §2.1)

The Adams–Bashforth methods were designed by John Couch Adams to solve a differential equation modelling capillary action due to Francis Bashforth. Bashforth (1883) published his theory and Adams' numerical method (Goldstine 1977).

Adams–Moulton methods

The Adams–Moulton methods are similar to the Adams–Bashforth methods in that they also have and . Again the b coefficients are chosen to obtain the highest order possible. However, the Adams–Moulton methods are implicit methods. By removing the restriction that , an s-step Adams–Moulton method can reach order , while an s-step Adams–Bashforth methods has only order s.

The Adams–Moulton methods with s = 0, 1, 2, 3, 4 are (Hairer, Nørsett & Wanner 1993, §III.1; Quarteroni, Sacco & Saleri 2000) listed, where the first two methods are the backward Euler method and the trapezoidal rule respectively:

The derivation of the Adams–Moulton methods is similar to that of the Adams–Bashforth method; however, the interpolating polynomial uses not only the points , as above, but also . The coefficients are given by

The Adams–Moulton methods are solely due to John Couch Adams, like the Adams–Bashforth methods. The name of Forest Ray Moulton became associated with these methods because he realized that they could be used in tandem with the Adams–Bashforth methods as a predictor-corrector pair (Moulton 1926); Milne (1926) had the same idea. Adams used Newton's method to solve the implicit equation (Hairer, Nørsett & Wanner 1993, §III.1).

Backward differentiation formulas (BDF)

The BDF methods are implicit methods with and the other coefficients chosen such that the method attains order s (the maximum possible). These methods are especially used for the solution of stiff differential equations.

Analysis

The central concepts in the analysis of linear multistep methods, and indeed any numerical method for differential equations, are convergence, order, and stability.

Consistency and order

The first question is whether the method is consistent: is the difference equation a good approximation of the differential equation ? More precisely, a multistep method is consistent if the local truncation error goes to zero faster than the step size h as h goes to zero, where the local truncation error is defined to be the difference between the result of the method, assuming that all the previous values are exact, and the exact solution of the equation at time . A computation using Taylor series shows that a linear multistep method is consistent if and only if All the methods mentioned above are consistent (Hairer, Nørsett & Wanner 1993, §III.2).

If the method is consistent, then the next question is how well the difference equation defining the numerical method approximates the differential equation. A multistep method is said to have order p if the local error is of order as h goes to zero. This is equivalent to the following condition on the coefficients of the methods: The s-step Adams–Bashforth method has order s, while the s-step Adams–Moulton method has order (Hairer, Nørsett & Wanner 1993, §III.2).

These conditions are often formulated using the characteristic polynomials In terms of these polynomials, the above condition for the method to have order p becomes In particular, the method is consistent if it has order at least one, which is the case if and .

Stability and convergence

The numerical solution of a one-step method depends on the initial condition , but the numerical solution of an s-step method depend on all the s starting values, . It is thus of interest whether the numerical solution is stable with respect to perturbations in the starting values. A linear multistep method is zero-stable for a certain differential equation on a given time interval, if a perturbation in the starting values of size ε causes the numerical solution over that time interval to change by no more than Kε for some value of K which does not depend on the step size h. This is called "zero-stability" because it is enough to check the condition for the differential equation (Süli & Mayers 2003, p. 332).

If the roots of the characteristic polynomial ρ all have modulus less than or equal to 1 and the roots of modulus 1 are of multiplicity 1, we say that the root condition is satisfied. A linear multistep method is zero-stable if and only if the root condition is satisfied (Süli & Mayers 2003, p. 335).

Now suppose that a consistent linear multistep method is applied to a sufficiently smooth differential equation and that the starting values all converge to the initial value as . Then, the numerical solution converges to the exact solution as if and only if the method is zero-stable. This result is known as the Dahlquist equivalence theorem, named after Germund Dahlquist; this theorem is similar in spirit to the Lax equivalence theorem for finite difference methods. Furthermore, if the method has order p, then the global error (the difference between the numerical solution and the exact solution at a fixed time) is (Süli & Mayers 2003, p. 340).

Furthermore, if the method is convergent, the method is said to be strongly stable if is the only root of modulus 1. If it is convergent and all roots of modulus 1 are not repeated, but there is more than one such root, it is said to be relatively stable. Note that 1 must be a root for the method to be convergent; thus convergent methods are always one of these two.

To assess the performance of linear multistep methods on stiff equations, consider the linear test equation y' = λy. A multistep method applied to this differential equation with step size h yields a linear recurrence relation with characteristic polynomial This polynomial is called the stability polynomial of the multistep method. If all of its roots have modulus less than one then the numerical solution of the multistep method will converge to zero and the multistep method is said to be absolutely stable for that value of hλ. The method is said to be A-stable if it is absolutely stable for all hλ with negative real part. The region of absolute stability is the set of all hλ for which the multistep method is absolutely stable (Süli & Mayers 2003, pp. 347 & 348). For more details, see the section on stiff equations and multistep methods.

Example

Consider the Adams–Bashforth three-step method One characteristic polynomial is thus which has roots , and the conditions above are satisfied. As is the only root of modulus 1, the method is strongly stable.

The other characteristic polynomial is

First and second Dahlquist barriers

These two results were proved by Germund Dahlquist and represent an important bound for the order of convergence and for the A-stability of a linear multistep method. The first Dahlquist barrier was proved in Dahlquist (1956) and the second in Dahlquist (1963).

First Dahlquist barrier

The first Dahlquist barrier states that a zero-stable and linear q-step multistep method cannot attain an order of convergence greater than q + 1 if q is odd and greater than q + 2 if q is even. If the method is also explicit, then it cannot attain an order greater than q (Hairer, Nørsett & Wanner 1993, Thm III.3.5).

Second Dahlquist barrier

The second Dahlquist barrier states that no explicit linear multistep methods are A-stable. Further, the maximal order of an (implicit) A-stable linear multistep method is 2. Among the A-stable linear multistep methods of order 2, the trapezoidal rule has the smallest error constant (Dahlquist 1963, Thm 2.1 and 2.2).

See also

References

  • Bashforth, Francis (1883), An Attempt to test the Theories of Capillary Action by comparing the theoretical and measured forms of drops of fluid. With an explanation of the method of integration employed in constructing the tables which give the theoretical forms of such drops, by J. C. Adams, Cambridge{{citation}}: CS1 maint: location missing publisher (link).
  • Butcher, John C. (2003), Numerical Methods for Ordinary Differential Equations, John Wiley, ISBN 978-0-471-96758-3.
  • Dahlquist, Germund (1956), "Convergence and stability in the numerical integration of ordinary differential equations", Mathematica Scandinavica, 4: 33–53, doi:10.7146/math.scand.a-10454.
  • Dahlquist, Germund (1963), "A special stability problem for linear multistep methods", BIT, 3: 27–43, doi:10.1007/BF01963532, ISSN 0006-3835, S2CID 120241743.
  • Goldstine, Herman H. (1977), A History of Numerical Analysis from the 16th through the 19th Century, New York: Springer-Verlag, ISBN 978-0-387-90277-7.
  • Hairer, Ernst; Nørsett, Syvert Paul; Wanner, Gerhard (1993), Solving ordinary differential equations I: Nonstiff problems (2nd ed.), Berlin: Springer Verlag, ISBN 978-3-540-56670-0.
  • Hairer, Ernst; Wanner, Gerhard (1996), Solving ordinary differential equations II: Stiff and differential-algebraic problems (2nd ed.), Berlin, New York: Springer-Verlag, ISBN 978-3-540-60452-5.
  • Iserles, Arieh (1996), A First Course in the Numerical Analysis of Differential Equations, Cambridge University Press, ISBN 978-0-521-55655-2.
  • Milne, W. E. (1926), "Numerical integration of ordinary differential equations", American Mathematical Monthly, 33 (9), Mathematical Association of America: 455–460, doi:10.2307/2299609, JSTOR 2299609.
  • Moulton, Forest R. (1926), New methods in exterior ballistics, University of Chicago Press.
  • Quarteroni, Alfio; Sacco, Riccardo; Saleri, Fausto (2000), Matematica Numerica, Springer Verlag, ISBN 978-88-470-0077-3.
  • Süli, Endre; Mayers, David (2003), An Introduction to Numerical Analysis, Cambridge University Press, ISBN 0-521-00794-1.

Read other articles:

1896 U.S. Supreme Court case on racial segregation Plessy redirects here. Not to be confused with Plessey. 1896 United States Supreme Court casePlessy v. FergusonSupreme Court of the United StatesArgued April 13, 1896Decided May 18, 1896Full case nameHomer A. Plessy v. John H. FergusonCitations163 U.S. 537 (more)16 S. Ct. 1138; 41 L. Ed. 256; 1896 U.S. LEXIS 3390DecisionOpinionCase historyPriorEx parte Plessy, 11 So. 948 (La. 1892)SubsequentNoneHoldingThe separate but equal provision of priva...

 

Легка атлетикаСтрибки з жердиною Арман ДюплантісУмови проведенняМісце у приміщенніРекорди (чоловіки)світу Арман Дюплантіс6,22 (2023)Європи Арман Дюплантіс6,22 (2023)України Сергій Бубка6,15 (1993) Див. також: Хронологія рекордів Європи з легкої атлетики – Стрибки з жердиною (чолові

 

Installer of solar street lights and small energy systems in Africa Akon Lighting AfricaMission statementProviding Africans with access to electricityType of projectNon CommercialLocationNations in AfricaOwnerAkonFounderAkonEstablishedFebruary 2014FundingChina Jiangsu International Economic And Technical Cooperation Group[1]StatusActive Akon Lighting Africa is a project started in 2014 by music artist Akon with Samba Bathily and Thione Niang which aims to provide electricity by solar ...

Artikel ini sebatang kara, artinya tidak ada artikel lain yang memiliki pranala balik ke halaman ini.Bantulah menambah pranala ke artikel ini dari artikel yang berhubungan atau coba peralatan pencari pranala.Tag ini diberikan pada Januari 2023. Anggrek mawar dalam bahasa Latin adalah Eria flavescens, tumbuhan ini merupakan tumbuhan asli yang berasal dari Jawa, Sumatra dan Malaysia.[1][2] Anggrek mawar termasuk dalam kategori suku Orchidaceae.[1] Tumbuhan ini merupakan ...

 

Rhinotomi adalah mutilasi, biasanya amputasi , pada hidung . Hukuman ini merupakan sarana hukuman yudisial di seluruh dunia, khususnya untuk pelanggaran seksual, namun dalam kasus perzinahan seringkali hanya diterapkan pada perempuan. Man without nose or hands, ca. 1910 Penggunaan kuno Print of Hindu scene: Shurpanakha (blue woman in foreground) has had her nose cut off by Lakshmana (with sword). Kode Hammurabi berisi referensi tentang amputasi tonjolan tubuh (seperti bibir, hidung, payudara,...

 

Football clubBarnsley Women's Football ClubFull nameBarnsley Women's Football ClubNickname(s)The RedsFounded1982GroundOlympic Legacy Park, SheffieldCapacity1,000Chief ExecutiveStephen MaddockManagerLois DanielsLeagueFA Women's National League Division One North2022–23FA Women's National League Division One North, 4th of 12WebsiteClub website Barnsley Women's Football Club is an English Women's Football Club based in Barnsley, South Yorkshire, England. The club currently plays in the FA Wome...

Desna barracks airstrike197 Sergeant Training Center A4224 Village of Desna, Chernihiv Oblast.TypeAirstrikeTarget Ukrainian Ground ForcesDateMay 17, 2022Executed by Russian Air ForceCasualties131 missing and killed vteRussian invasion of UkraineNorthern Ukraine campaign Antonov Airport Chernobyl Hostomel Ivankiv Kyiv airstrikes shopping centre bombing Kyiv convoy Vasylkiv Bucha massacre Irpin refugee column shelling Makariv Moshchun Brovary Slavutych Borodianka Hlukhiv Konotop ...

 

Instituto Francés de Ciencias Administrativas(IFSA)Acrónimo IFSATipo Asociación de utilidad públicaFundación 1947Sede central  Francia 1, place du Palais Royal 75100 Paris Cedex 01Oficina CentralPresidente Jean-Marc SauvéMiembros 300EstructuraSitio web www.ifsa.fr[editar datos en Wikidata] El Instituto Francés de Ciencias Administrativas (IFSA) fue creado en 1947 por René Cassin. Está reconocido como asociación de utilidad pública y es miembro del Instituto Internaci...

 

This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages) This article includes a list of references, related reading, or external links, but its sources remain unclear because it lacks inline citations. Please help to improve this article by introducing more precise citations. (August 2012) (Learn how and when to remove this template message) This article needs additional citations for verificatio...

Campeonato Europeu de Estados Pequenos Voleibol Sede Europa Organizador CEV Edições Primeira edição Malta 2000 Edição atual Ilhas Feroé 2019 Campeões Primeiro campeão Chipre Atual campeão Escócia (1º título) Maior campeão Chipre (7 títulos) O Campeonato Europeu de Estados Pequenos de Voleibol Masculino é uma competição criada pela CEV em 2000 e reservado para os países europeus de tamanho pequenos (ou micro-estados) ou população muito reduzida, os quais teriam pouca oport...

 

‹ 1964 •  • 1968 › Wahlen zum Senat 1966 Siegel des Senats der Vereinigten Staaten 8. November 1966 33 Senatoren der Klasse II (sowie 2 Senatoren der Klassen I und III) Demokraten Davor 67   Danach 64      64 % der Sitze Republikaner Davor 33   Danach 36      36 % der Sitze Wahlergebnisse nach Bundesstaat   17 Wahlen/Sitze gewonnen  Demokraten  ...

 

Bahasa Tionghoa 汉语/漢語 atau 中文Hànyǔ atau Zhōngwén Hànyǔ (Bahasa Tionghoa) ditulis dalam aksara tradisional (kiri) dan sederhana (kanan)Dituturkan diTiongkok Daratan, Taiwan, Jepang, Singapura, Malaysia, Amerika Serikat, Kanada, Britania Raya, Irlandia, Australia, Selandia Baru, Indonesia, Filipina, dan tempat-tempat lain dengan masyarakat Tionghoa perantauan yang signifikanEtnisHanPenutur(1.200 milyar per 1984–2001)[1]Rumpun bahasaSino-Tibet SinitikBahasa Tio...

Japanese politician (1836–1915) MarquessInoue Kaoru 井上 馨GCMGMarquis Inoue KaoruMinister for Foreign Affairs of JapanIn office22 December 1885 – 17 September 1887Preceded bynoneSucceeded byItō HirobumiMinister of Agriculture and CommerceIn office25 July 1888 – 23 December 1889Preceded byKuroda KiyotakaSucceeded byIwamura MichitoshiHome MinisterIn office8 August 1892 – 15 October 1894Preceded byKōno TogamaSucceeded byNomura YasushiFinance MinisterIn of...

 

Ola UllstenOla Ullsten[[Perdana Menteri Swedia]] 28Masa jabatan18 Oktober 1978 – 12 Oktober 1979Penguasa monarkiCarl XVI GustafPendahuluThorbjörn FälldinPenggantiThorbjörn FälldinMenteri Luar Negeri SwediaMasa jabatan12 Oktober 1979 – 8 Oktober 1982Perdana MenteriThorbjörn FälldinPendahuluHans BlixPenggantiLennart BodströmWakil Perdana Menteri SwediaMasa jabatan1 Agustus 1980 – 8 Oktober 1982Perdana MenteriThorbjörn FälldinPendahuluIngemar Mundebo...

 

This is the timeline for Southern Railway zone that encompasses over present day Tamil Nadu, Kerala and parts of Andhra Pradesh and Karnataka. Timeline 19th century Nilgiri Mountain Railway working under Southern Railway zone, Chennai and also it is UNESCO World Heritage site. 1845 Madras Railway Company was launched. 1853 Madras Railway Company, registered in Chennai (Royapuram) began work. 1856 First passenger rail service began in Royapuram - Walajapet (Walaja Road) route. Perambur loco wo...

CloudBook Тип Субноутбук Производи­тель Everex[d] Дата выпуска 15 февраля 2008 Процессор VIA C7-M ULV 1,2 ГГц Оперативная память 512 МиБ (расширяемое до 1 ГиБ) Чипсет VIA Устройства хранения данных жёсткий диск 30 ГиБ ОС gOS Rocket (с оконным менеджером GNOME) CloudBook — субноутбук, разработанный ком...

 

Finnish manufacturing company This article contains paid contributions. It may require cleanup to comply with Wikipedia's content policies, particularly neutral point of view. Please discuss further on the talk page. Componenta CorporationTypeJulkinen osakeyhtiö(Public company)Traded asNasdaq Helsinki: CTH1VHeadquartersVantaa, FinlandArea servedWorldwideKey peopleSami Sivuranta (CEO)Revenue70.0 million euros (2020)[1]Operating income€3.7 million (2020)[1]Net income€-...

 

SMA Negeri 104 JakartaInformasiDidirikan1990JenisNegeri di bawah DiknasAkreditasiA [1]Nomor Statistik Sekolah301001640182Nomor Pokok Sekolah Nasional20103291Kepala SekolahEljulKetua KomiteH. Puguh Budi Raharjo, MBAJumlah kelasX MIPA: 4 kelasX IPS: 4 kelasXI MIPA: 5 kelasXI IPS: 3 kelasXII IPA: 5 kelasXII IPS: 3 kelasJurusan atau peminatanMIIA, IIS, IPA dan IPSRentang kelasX MIIA, X IIS, XI IPA, XI IPS, XII IPA, XII IPSKurikulumKurikulum Tingkat Satuan Pendidikan dan Kur...

Tungusic language of the Russian Far East NegidalНеғида хэсэнинNative toRussiaRegionRussian Far EastEthnicity510 Negidals (2010 census)[1]Native speakers75 (2010 census)[1](only a few fully fluent by 2007)[1]Language familyTungusic NorthernEvenki groupNegidalWriting systemCyrillicLanguage codesISO 639-3negGlottolognegi1245ELPNegidalNegidal is classified as Critically Endangered by the UNESCO Atlas of the World's Languages in Danger Negidal (also ...

 

English band For the French electronic music band, see Space (French band). For the English ambient electronic act credited as Space in 1990, see Jimmy Cauty. For the English band briefly credited as Space on some mid-1970s releases, see The Tremeloes. SpaceThree members of Space playing a secret gigBackground informationOriginLiverpool, EnglandGenresAlternative dance, alternative rock, alternative hip hop, neo-psychedeliaYears active1992–2005; 2011–presentLabelsGut RecordsUniversal Recor...

 

Strategi Solo vs Squad di Free Fire: Cara Menang Mudah!