Numerical analysis

Babylonian clay tablet YBC 7289 (c. 1800–1600 BCE) with annotations. The approximation of the square root of 2 is four sexagesimal figures, which is about six decimal figures. ${\displaystyle 1+24/60+51/60^{2}+10/60^{3}\approx 1.41421296}$^[1]

Numerical analysis studies different algorithms to get approximations for problems of mathematical analysis. Approximations are used for the following reasons:

1. There are no known ways to solve a problem using calculus. Examples for such problems are the Navier–Stokes equations^[2][3][4][5] or the Three-body problem
2. There is a way to solve a problem using calculus. Getting an exact solution is impractical though, because it requires a long time, or many resources. An example for this is calculating power series.

One of the earliest known uses of numerical analysis is a Babylonian clay tablet, which approximates the square root of 2. In a unit square, the diagonal has this length. Being able to compute the sides of a triangle is extremely important, for instance, in carpentry and construction.^[6]

Numerical analysis continues this long tradition of practical mathematical calculations. Much like the Babylonian approximation of ${\displaystyle {\sqrt {2}}}$, modern numerical analysis does not seek exact answers, because exact answers are often impossible to obtain in practice. Instead, much of numerical analysis is concerned with obtaining approximate solutions while maintaining reasonable bounds on errors.

Numerical analysis naturally finds applications in all fields of engineering and the physical sciences,^[7] but in the 21st century, the life sciences and even the arts have adopted elements of scientific computations. Ordinary differential equations appear in star movement; optimization occurs in portfolio management; numerical linear algebra is important for data analysis;^[8][9][10] stochastic differential equations^{[11][12][13][14][15]} and Markov chains^[16] are essential in simulating living cells for medicine and biology.^[17]

Computers greatly helped this task. Before there were computers, numerical methods often depended on hand interpolation in large printed tables. Since the mid 20th century, computers calculate the required functions instead.^[18] These same interpolation formulas nevertheless continue to be used as part of the software algorithms for solving differential equations.^[19][20][21]

Famous numerical software

In order to support numerical analysts, many kinds of numerical software has been created:

• MatLab^[22][23][24] - made by MathWorks
  • GNU Octave, Scilab - open source versions of MATLAB
• SageMath^[25]
• SciPy^[26][27][28]
• Wolfram Mathematica^{[29][30][31][32]} - made by Wolfram Research

References

1. "Photograph, illustration, and description of the root(2) tablet from the Yale Babylonian Collection". Archived from the original on 2012-08-13. Retrieved 2012-03-25.
2. Constantin, P., & Foias, C. (1988). Navier-stokes equations. University of Chicago Press.
3. Temam, R. (2001). Navier-Stokes equations: theory and numerical analysis (Vol. 343). American Mathematical Society.
4. Foias, C., Manley, O., Rosa, R., & Temam, R. (2001). Navier-Stokes equations and turbulence (Vol. 83). Cambridge University Press.
5. Girault, V., & Raviart, P. A. (2012). Finite element methods for Navier-Stokes equations: theory and algorithms (Vol. 5). Springer Science & Business Media.
6. The New Zealand Qualification authority specifically mentions this skill in document 13004 version 2, dated 17 October 2003 titled CARPENTRY THEORY: Demonstrate knowledge of setting out a building
7. Garcia, A. L. (2000). Numerical methods for physics. Englewood Cliffs, NJ: Prentice Hall.
8. Demmel, J. W. (1997). Applied numerical linear algebra. SIAM.
9. Ciarlet, P. G., Miara, B., & Thomas, J. M. (1989). Introduction to numerical linear algebra and optimization. Cambridge University Press.
10. Trefethen, Lloyd; Bau III, David (1997). Numerical Linear Algebra (1st ed.). Philadelphia: SIAM.
11. Kloeden, P. E., & Platen, E. (2013). Numerical solution of stochastic differential equations (Vol. 23). Springer Science & Business Media.
12. Oksendal, B. (2013). Stochastic differential equations: an introduction with applications. Springer Science & Business Media.
13. Mao, X., & Yuan, C. (2006). Stochastic differential equations with Markovian switching. Imperial College Press.
14. Mao, X. (2007). Stochastic differential equations and applications. Elsevier.
15. Platen, E. (1999). An introduction to numerical methods for stochastic differential equations. Acta Numerica, 8, 197-246.
16. Behrends, E. (2000). Introduction to Markov chains (Vol. 228). Braunschweig/Wiesbaden: Vieweg.
17. Tass, P. A. (2007). Phase resetting in medicine and biology: stochastic modelling and data analysis. Springer Science & Business Media.
18. Brezinski, C., & Wuytack, L. (2012). Numerical analysis: Historical developments in the 20th century. Elsevier.
19. Iserles, A. (2009). A first course in the numerical analysis of differential equations. Cambridge University Press.
20. Ames, W. F. (2014). Numerical methods for partial differential equations. Academic Press.
21. M. Nakao, M. Plum, Y. Watanabe (2019) Numerical Verification Methods and Computer-Assisted Proofs for Partial Differential Equations (Springer Series in Computational Mathematics).
22. Quarteroni, A., Saleri, F., & Gervasio, P. (2006). Scientific computing with MATLAB and Octave. Berlin: Springer.
23. Gander, W., & Hrebicek, J. (Eds.). (2011). Solving problems in scientific computing using Maple and Matlab®. Springer Science & Business Media.
24. Barnes, B., & Fulford, G. R. (2011). Mathematical modelling with case studies: a differential equations approach using Maple and MATLAB. Chapman and Hall/CRC.
25. Zimmermann, P., Casamayou, A., Cohen, N., Connan, G., Dumont, T., Fousse, L., ... & Thiéry, N. M. (2018). Computational mathematics with SageMath. Society for Industrial and Applied Mathematics.
26. Jones, E., Oliphant, T., & Peterson, P. (2001). SciPy: Open source scientific tools for Python.
27. Bressert, E. (2012). SciPy and NumPy: an overview for developers. " O'Reilly Media, Inc.".
28. Blanco-Silva, F. J. (2013). Learning SciPy for numerical and scientific computing. Packt Publishing Ltd.
29. Maeder, R. E. (1991). Programming in mathematica. Addison-Wesley Longman Publishing Co., Inc..
30. Stephen Wolfram. (1999). The MATHEMATICA® book, version 4. Cambridge University Press.
31. Shaw, W. T., & Tigg, J. (1993). Applied Mathematica: getting started, getting it done. Addison-Wesley Longman Publishing Co., Inc..
32. Marasco, A., & Romano, A. (2001). Scientific Computing with Mathematica: Mathematical Problems for Ordinary Differential Equations; with a CD-ROM. Springer Science & Business Media.

Researchers

• James H. Wilkinson
• Leonid Kantorovich
• Masaaki Sugihara
• Masao Iri
• Masatake Mori
• Peter Deuflhard
• Peter Lax
• Shinichi Oishi

Related pages

• Finite element method
• Mathematical analysis
• Newton's method
• Numerical digit
• Numerical integration
• Numerical linear algebra
• Numerical methods for ordinary differential equations
• Numerical methods for partial differential equations
• Parallel computing
• Series acceleration
• Validated numerics
  • Affine arithmetic
  • International Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics
  • Interval arithmetic
  • IntLab

Further reading

• Higham, Nicholas J. (1996). Accuracy and Stability of Numerical Algorithms. Society for Industrial and Applied Mathematics.
• Gautschi, W. (1997). Numerical analysis. Springer Science & Business Media.
• Leader, Jeffery J. (2004). Numerical Analysis and Scientific Computation. Addison Wesley.
• Quarteroni, A., Sacco, R., & Saleri, F. (2010). Numerical mathematics. Springer Science & Business Media.
• Stoer, J., & Bulirsch, R. (2013). Introduction to numerical analysis. Springer Science & Business Media.
• Conte, S. D., & De Boor, C. (2017). Elementary numerical analysis: an algorithmic approach. Society for Industrial and Applied Mathematics.
• Greenspan, D. (2018). Numerical Analysis. CRC Press.
• Linz, P. (2019). Theoretical numerical analysis. Courier Dover Publications.