Trending ▼   ResFinder  

Maths Formulae

65 pages, 0 questions, 0 questions with responses, 0 total responses,    0    0
Aman Singh
 Pilibhit  		+Fave Message
ProfileTimelineUploads
 Home > aman09064 >

Formatting page ...

Mathematics Formulary By ir. J.C.A. Wevers c 1999, 2008 J.C.A. Wevers Version: May 4, 2008 Dear reader, This document contains 66 pages with mathematical equations intended for physicists and engineers. It is intended to be a short reference for anyone who often needs to look up mathematical equations. This document can also be obtained from the author, Johan Wevers (johanw@vulcan.xs4all.nl). It can also be found on the WWW on http://www.xs4all.nl/ johanw/index.html. This document is Copyright by J.C.A. Wevers. All rights reserved. Permission to use, copy and distribute this unmodi ed document by any means and for any purpose except pro t purposes is hereby granted. Reproducing this document by any means, included, but not limited to, printing, copying existing prints, publishing by electronic or other means, implies full agreement to the above non-pro t-use clause, unless upon explicit prior written permission of the author. The C code for the root nding via Newtons method and the FFT in chapter 8 are from Numerical Recipes in C , 2nd Edition, ISBN 0-521-43108-5. A The Mathematics Formulary is made with teTEX and LTEX version 2.09. If you prefer the notation in which vectors are typefaced in boldface, uncomment the rede nition of the \vec command and recompile the le. If you nd any errors or have any comments, please let me know. I am always open for suggestions and possible corrections to the mathematics formulary. Johan Wevers Contents Contents 1 I Basics 1.1 Goniometric functions . . . . . . . . . . . . . . 1.2 Hyperbolic functions . . . . . . . . . . . . . . . 1.3 Calculus . . . . . . . . . . . . . . . . . . . . . . 1.4 Limits . . . . . . . . . . . . . . . . . . . . . . . 1.5 Complex numbers and quaternions . . . . . . . . 1.5.1 Complex numbers . . . . . . . . . . . . 1.5.2 Quaternions . . . . . . . . . . . . . . . . 1.6 Geometry . . . . . . . . . . . . . . . . . . . . . 1.6.1 Triangles . . . . . . . . . . . . . . . . . 1.6.2 Curves . . . . . . . . . . . . . . . . . . 1.7 Vectors . . . . . . . . . . . . . . . . . . . . . . 1.8 Series . . . . . . . . . . . . . . . . . . . . . . . 1.8.1 Expansion . . . . . . . . . . . . . . . . . 1.8.2 Convergence and divergence of series . . 1.8.3 Convergence and divergence of functions 1.9 Products and quotients . . . . . . . . . . . . . . 1.10 Logarithms . . . . . . . . . . . . . . . . . . . . 1.11 Polynomials . . . . . . . . . . . . . . . . . . . . 1.12 Primes . . . . . . . . . . . . . . . . . . . . . . . 2 Probability and statistics 2.1 Combinations . . . . 2.2 Probability theory . . 2.3 Statistics . . . . . . . 2.3.1 General . . . 2.3.2 Distributions 2.4 Regression analyses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1 1 2 3 3 3 3 4 4 4 4 5 5 5 6 7 7 7 7 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 9 9 9 9 10 11 3 Calculus 3.1 Integrals . . . . . . . . . . . . . . . . . . 3.1.1 Arithmetic rules . . . . . . . . . 3.1.2 Arc lengts, surfaces and volumes . 3.1.3 Separation of quotients . . . . . . 3.1.4 Special functions . . . . . . . . . 3.1.5 Goniometric integrals . . . . . . . 3.2 Functions with more variables . . . . . . 3.2.1 Derivatives . . . . . . . . . . . . 3.2.2 Taylor series . . . . . . . . . . . 3.2.3 Extrema . . . . . . . . . . . . . . 3.2.4 The -operator . . . . . . . . . . 3.2.5 Integral theorems . . . . . . . . . 3.2.6 Multiple integrals . . . . . . . . . 3.2.7 Coordinate transformations . . . . 3.3 Orthogonality of functions . . . . . . . . 3.4 Fourier series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 12 12 12 13 13 14 14 14 15 15 16 17 17 18 18 18 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I Mathematics Formulary door J.C.A. Wevers II 4 5 6 Differential equations 4.1 Linear differential equations . . . . . . . . . 4.1.1 First order linear DE . . . . . . . . . 4.1.2 Second order linear DE . . . . . . . . 4.1.3 The Wronskian . . . . . . . . . . . . 4.1.4 Power series substitution . . . . . . . 4.2 Some special cases . . . . . . . . . . . . . . 4.2.1 Frobenius method . . . . . . . . . . 4.2.2 Euler . . . . . . . . . . . . . . . . . 4.2.3 Legendre s DE . . . . . . . . . . . . 4.2.4 The associated Legendre equation . . 4.2.5 Solutions for Bessel s equation . . . . 4.2.6 Properties of Bessel functions . . . . 4.2.7 Laguerre s equation . . . . . . . . . . 4.2.8 The associated Laguerre equation . . 4.2.9 Hermite . . . . . . . . . . . . . . . . 4.2.10 Chebyshev . . . . . . . . . . . . . . 4.2.11 Weber . . . . . . . . . . . . . . . . . 4.3 Non-linear differential equations . . . . . . . 4.4 Sturm-Liouville equations . . . . . . . . . . 4.5 Linear partial differential equations . . . . . . 4.5.1 General . . . . . . . . . . . . . . . . 4.5.2 Special cases . . . . . . . . . . . . . 4.5.3 Potential theory and Green s theorem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 20 20 20 21 21 21 21 22 22 22 22 23 23 24 24 24 24 24 25 25 25 25 27 Linear algebra 5.1 Vector spaces . . . . . . . . . . . . . . 5.2 Basis . . . . . . . . . . . . . . . . . . . 5.3 Matrix calculus . . . . . . . . . . . . . 5.3.1 Basic operations . . . . . . . . 5.3.2 Matrix equations . . . . . . . . 5.4 Linear transformations . . . . . . . . . 5.5 Plane and line . . . . . . . . . . . . . . 5.6 Coordinate transformations . . . . . . . 5.7 Eigen values . . . . . . . . . . . . . . . 5.8 Transformation types . . . . . . . . . . 5.9 Homogeneous coordinates . . . . . . . 5.10 Inner product spaces . . . . . . . . . . 5.11 The Laplace transformation . . . . . . . 5.12 The convolution . . . . . . . . . . . . . 5.13 Systems of linear differential equations . 5.14 Quadratic forms . . . . . . . . . . . . . 5.14.1 Quadratic forms in I 2 . . . . . R 5.14.2 Quadratic surfaces in I 3 . . . . R . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 29 29 29 29 30 31 31 32 32 32 35 36 36 37 37 38 38 38 Complex function theory 6.1 Functions of complex variables . . . . 6.2 Complex integration . . . . . . . . . 6.2.1 Cauchy s integral formula . . 6.2.2 Residue . . . . . . . . . . . . 6.3 Analytical functions de nied by series 6.4 Laurent series . . . . . . . . . . . . . 6.5 Jordan s theorem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 39 39 39 40 41 41 42 . . . . . . . Mathematics Formulary by J.C.A. Wevers 7 Tensor calculus 7.1 Vectors and covectors . . . . . . . . . . 7.2 Tensor algebra . . . . . . . . . . . . . . 7.3 Inner product . . . . . . . . . . . . . . 7.4 Tensor product . . . . . . . . . . . . . 7.5 Symmetric and antisymmetric tensors . 7.6 Outer product . . . . . . . . . . . . . . 7.7 The Hodge star operator . . . . . . . . 7.8 Differential operations . . . . . . . . . 7.8.1 The directional derivative . . . . 7.8.2 The Lie-derivative . . . . . . . 7.8.3 Christoffel symbols . . . . . . . 7.8.4 The covariant derivative . . . . 7.9 Differential operators . . . . . . . . . . 7.10 Differential geometry . . . . . . . . . . 7.10.1 Space curves . . . . . . . . . . 7.10.2 Surfaces in I 3 . . . . . . . . . R 7.10.3 The rst fundamental tensor . . 7.10.4 The second fundamental tensor 7.10.5 Geodetic curvature . . . . . . . 7.11 Riemannian geometry . . . . . . . . . . 8 Numerical mathematics 8.1 Errors . . . . . . . . . . . . . 8.2 Floating point representations . 8.3 Systems of equations . . . . . 8.3.1 Triangular matrices . . 8.3.2 Gauss elimination . . 8.3.3 Pivot strategy . . . . . 8.4 Roots of functions . . . . . . . 8.4.1 Successive substitution 8.4.2 Local convergence . . 8.4.3 Aitken extrapolation . 8.4.4 Newton iteration . . . 8.4.5 The secant method . . 8.5 Polynomial interpolation . . . 8.6 De nite integrals . . . . . . . 8.7 Derivatives . . . . . . . . . . 8.8 Differential equations . . . . . 8.9 The fast Fourier transform . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . III . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43 43 44 44 45 45 45 46 46 46 46 46 47 47 48 48 48 49 49 49 50 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 51 51 52 52 52 53 53 53 53 54 54 55 55 56 56 57 58 IV Mathematics Formulary door J.C.A. Wevers Chapter 1 Basics 1.1 Goniometric functions For the goniometric ratios for a point p on the unit circle holds: cos( ) = xp , sin( ) = yp , tan( ) = yp xp sin2 (x) + cos2 (x) = 1 and cos 2 (x) = 1 + tan2 (x). cos(a b) = cos(a) cos(b) sin(a) sin(b) , sin(a b) = sin(a) cos(b) cos(a) sin(b) tan(a b) = tan(a) tan(b) 1 tan(a) tan(b) The sum formulas are: sin(p) + sin(q ) sin(p) sin(q ) cos(p) + cos(q ) cos(p) cos(q ) = 2 sin( 1 (p + q )) cos( 1 (p q )) 2 2 = 2 cos( 1 (p + q )) sin( 1 (p q )) 2 2 1 = 2 cos( 2 (p + q )) cos( 1 (p q )) 2 = 2 sin( 1 (p + q )) sin( 1 (p q )) 2 2 From these equations can be derived that 2 cos2 (x) = 1 + cos(2x) sin( x) = sin(x) 1 sin( 2 x) = cos(x) 2 sin2 (x) = 1 cos(2x) cos( x) = cos(x) cos( 1 x) = sin(x) 2 , , , Conclusions from equalities: x = a 2k or x = ( a) 2k , k I N x = a 2k or x = a 2k tan(x) = tan(a) x = a k and x = k 2 The following relations exist between the inverse goniometric functions: sin(x) = sin(a) cos(x) = cos(a) arctan(x) = arcsin 1.2 x x2 +1 1 = arccos cosh(x) = ex + e x , 2 x2 +1 , sin(arccos(x)) = Hyperbolic functions The hyperbolic functions are de ned by: sinh(x) = ex e x , 2 tanh(x) = sinh(x) cosh(x) From this follows that cosh2 (x) sinh2 (x) = 1. Further holds: arsinh(x) = ln |x + x2 + 1| , arcosh(x) = arsinh( x2 1) 1 1 x2 Mathematics Formulary by ir. J.C.A. Wevers 2 1.3 Calculus The derivative of a function is de ned as: df f (x + h) f (x) = lim dx h 0 h Derivatives obey the following algebraic rules: x y d(x y ) = dx dy , d(xy ) = xdy + ydx , d = ydx xdy y2 For the derivative of the inverse function f inv (y ), de ned by f inv (f (x)) = x, holds at point P = (x, f (x)): df inv (y ) dy df (x) dx P =1 P Chain rule: if f = f (g (x)), then holds df dg df = dx dg dx Further, for the derivatives of products of functions holds: n ( n) (f g ) = k=0 n (n k) (k) f g k For the primitive function F (x) holds: F (x) = f (x). An overview of derivatives and primitives is: f (x)dx y = f (x) dy/dx = f (x) axn 1/x a anxn 1 x 2 0 a(n + 1) 1 xn+1 ln |x| ax ax ex a log(x) ln(x) sin(x) cos(x) tan(x) sin 1 (x) sinh(x) cosh(x) arcsin(x) arccos(x) arctan(x) ax ln(a) ex (x ln(a)) 1 1/x cos(x) sin(x) cos 2 (x) sin 2 (x) cos(x) cosh(x) sinh(x) 1/ x2 1 1/ 1 x2 (1 + x2 ) 1 (a + x2 ) 1/2 x(a + x2 ) 3/2 (a2 x2 ) 1 2x(a2 + x2 ) 2 ax / ln(a) ex (x ln(x) x)/ ln(a) x ln(x) x cos(x) sin(x) ln | cos(x)| ln | tan( 1 x)| 2 cosh(x) sinh(x ) x arcsin(x) + 1 x2 x arccos(x) 1 x2 x arctan(x) 1 ln(1 + x2 ) 2 ln |x + a + x2 | 1 ln |(a + x)/(a x)| 2a The curvature of a curve is given by: = (1 + (y )2 )3/2 |y | The theorem of De l H pital: if f (a) = 0 and g (a) = 0, then is lim o x a f (x) f (x) = lim g (x) x a g (x) Chapter 1: Basics 1.4 3 Limits ex 1 tan(x) sin(x) = 1 , lim = 1 , lim = 1 , lim (1 + k )1/k = e , x 0 x 0 x 0 k 0 x x x lim lnp (x) ln(x + a) = 0 , lim =a , a x x 0 x x lim xa ln(x) = 0 , arcsin(x) =1 , x 0 x lim a1/x 1 = ln(a) , lim x 0 1.5 x 1+ n x x = en xp = 0 als |a| > 1. x ax lim x 0 lim lim lim x x x=1 Complex numbers and quaternions 1.5.1 Complex numbers The complex number z = a + bi with a and b I . a is the real part, b the imaginary part of z . |z | = a2 + b2 . R By de nition holds: i2 = 1. Every complex number can be written as z = |z | exp(i ), with tan( ) = b/a. The complex conjugate of z is de ned as z = z := a bi. Further holds: (a + bi)(c + di) = (ac bd) + i(ad + bc) (a + bi) + (c + di) = a + c + i(b + d) a + bi (ac + bd) + i(bc ad) = c + di c2 + d2 Goniometric functions can be written as complex exponents: sin(x) = cos(x) = 1 ix (e e ix ) 2i 1 ix (e + e ix ) 2 From this follows that cos(ix) = cosh(x) and sin(ix) = i sinh(x). Further follows from this that e ix = cos(x) i sin(x), so eiz = 0 z . Also the theorem of De Moivre follows from this: (cos( ) + i sin( ))n = cos(n ) + i sin(n ). Products and quotients of complex numbers can be written as: z1 z2 z1 z2 = |z1 | |z2 |(cos( 1 + 2 ) + i sin( 1 + 2 )) |z1 | = (cos( 1 2 ) + i sin( 1 2 )) |z2 | The following can be derived: |z1 + z2 | |z1 | + |z2 | , |z1 z2 | | |z1 | |z2 | | And from z = r exp(i ) follows: ln(z ) = ln(r) + i , ln(z ) = ln(z ) 2n i. 1.5.2 Quaternions Quaternions are de ned as: z = a + bi + cj + dk , with a, b, c, d I and i2 = j 2 = k 2 = 1. The products of R i, j, k with each other are given by ij = ji = k , jk = kj = i and ki = ik = j . Mathematics Formulary by ir. J.C.A. Wevers 4 1.6 Geometry 1.6.1 Triangles The sine rule is: a b c = = sin( ) sin( ) sin( ) Here, is the angle opposite to a, is opposite to b and opposite to c. The cosine rule is: a2 = b2 + c2 2bc cos( ). For each triangle holds: + + = 180 . Further holds: 1 tan( 2 ( + )) a+b = 1 a b tan( 2 ( )) 1 The surface of a triangle is given by 2 ab sin( ) = 1 aha = 2 1 a and s = 2 (a + b + c). s(s a)(s b)(s c) with ha the perpendicular on 1.6.2 Curves Cycloid: if a circle with radius a rolls along a straight line, the trajectory of a point on this circle has the following parameter equation: x = a(t + sin(t)) , y = a(1 + cos(t)) Epicycloid: if a small circle with radius a rolls along a big circle with radius R, the trajectory of a point on the small circle has the following parameter equation: x = a sin R+a t + (R + a) sin(t) , y = a cos a R+a t + (R + a) cos(t) a Hypocycloid: if a small circle with radius a rolls inside a big circle with radius R, the trajectory of a point on the small circle has the following parameter equation: x = a sin R a t + (R a) sin(t) , y = a cos a R a t + (R a) cos(t) a A hypocycloid with a = R is called a cardioid. It has the following parameterequation in polar coordinates: r = 2a[1 cos( )]. 1.7 Vectors The inner product is de ned by: a b = ai bi = |a | |b | cos( ) i where is the angle between a and b. The external product is in I 3 de ned by: R ay bz az by a b = az bx ax bz = ax by ay bx ex ax bx ey ay by ez az bz Further holds: |a b | = |a | |b | sin( ), and a (b c ) = (a c )b (a b )c. Chapter 1: Basics 1.8 5 Series 1.8.1 Expansion The Binomium of Newton is: n n n k k a b k (a + b)n = k=0 where n k := n! . k !(n k )! n rk and r By subtracting the series n rk one nds: k=0 k=0 n rk = 1 rn+1 1 r rk = 1 . 1 r k=0 and for |r| < 1 this gives the geometric series: k=0 N 1 (a + nV ) = a(N + 1) + 2 N (N + 1)V . The arithmetic series is given by: n=0 The expansion of a function around the point a is given by the Taylor series: f (x) = f (a) + (x a)f (a) + (x a)n (n) (x a)2 f (a) + + f (a) + R 2 n! where the remainder is given by: Rn (h) = (1 )n hn (n+1) f ( h) n! and is subject to: M hn+1 mhn+1 Rn (h) (n + 1)! (n + 1)! From this one can deduce that (1 x) = n=0 One can derive that: 1 2 = , n2 6 n=1 1 4 = , n4 90 n=1 n k 2 = 1 n(n + 1)(2n + 1) , 6 k=1 1 = 2 1 4n n=1 , 1 6 = n6 945 n=1 ( 1)n+1 2 = , n2 12 n=1 1 2 n x n 1 2 = , (2n 1)2 8 n=1 ( 1)n+1 = ln(2) n n=1 1 4 = , (2n 1)4 96 n=1 ( 1)n+1 3 = (2n 1)3 32 n=1 1.8.2 Convergence and divergence of series |un | converges, If n un also converges. n If lim un = 0 then n un is divergent. n An alternating series of which the absolute values of the terms drop monotonously to 0 is convergent (Leibniz). Mathematics Formulary by ir. J.C.A. Wevers 6 If p f (x)dx < , then fn is convergent. n If un > 0 n then is un convergent if n ln(un + 1) is convergent. n If un = cn xn the radius of convergence of un is given by: n 1 = lim n n |cn | = lim n cn+1 . cn The series 1 is convergent if p > 1 and divergent if p 1. np n=1 un = p, than the following is true: if p > 0 than un and vn n p = 0 holds: if vn is convergent, than un is also convergent. If: lim n n vn are both divergent or both convergent, if n n n If L is de ned by: L = lim n |nn |, or by: L = lim n un+1 , then is un un divergent if L > 1 and convergent if n L < 1. 1.8.3 Convergence and divergence of functions f (x) is continuous in x = a only if the upper - and lower limit are equal: lim f (x) = lim f (x). This is written as: x a x a f (a ) = f (a+ ). If f (x) is continuous in a and: lim f (x) = lim f (x), than f (x) is differentiable in x = a. x a We de ne: f x a := sup(|f (x)| |x W ), and lim fn (x) = f (x). Than holds: {fn } is uniform convergent if W x fn f = 0, or: ( > 0) (N ) (n N ) fn f < . lim n un Weierstrass test: if W is convergent, than b un (x) and F (y ) = We de ne S (x) = n=N Theorem For rows C un is uniform convergent. series integral rows f (x, y )dx := F . Than it can be proved that: a Demands on W fn continuous, {fn } uniform convergent S (x) uniform convergent, un continuous f is continuous fn can be integrated, {fn } uniform convergent Than holds on W f is continuous S is continuous F is continuous fn can be integrated, f (x)dx = lim fn dx n S (x) is uniform convergent, un can be integrated f is continuous rows D series integral I {fn } C 1 ; {fn } unif.conv f = (x) series un C 1 ; S (x) = integral f / y continuous un conv; S can be integrated, F dy = un u.c. Fy = S dx = f (x, y )dxdy un (x) fy (x, y )dx un dx Chapter 1: Basics 1.9 7 Products and quotients For a, b, c, d I holds: R The distributive property: (a + b)(c + d) = ac + ad + bc + bd The associative property: a(bc) = b(ac) = c(ab) and a(b + c) = ab + ac The commutative property: a + b = b + a, ab = ba. Further holds: a2n b2n = a2n 1 a2n 2 b + a2n 3 b2 b2n 1 , a b a2n+1 b2n+1 = a+b (a b)(a2 ab + b2 ) = a3 b3 , (a + b)(a b) = a2 + b2 , 1.10 n a2n k b2k k=0 a3 b3 = a2 a+b ba + b2 Logarithms De nition: a log(x) = b ab = x. For logarithms with base e one writes ln(x). Rules: log(xn ) = n log(x), log(a) + log(b) = log(ab), log(a) log(b) = log(a/b). 1.11 Polynomials Equations of the type n ak xk = 0 k=0 have n roots which may be equal to each other. Each polynomial p(z ) of order n 1 has at least one root in C . If all ak I holds: when x = p with p C a root, than p is also a root. Polynomials up to and including order 4 R have a general analytical solution, for polynomials with order 5 there does not exist a general analytical solution. For a, b, c I and a = 0 holds: the 2nd order equation ax2 + bx + c = 0 has the general solution: R b b2 4ac x= 2a For a, b, c, d I and a = 0 holds: the 3rd order equation ax3 + bx2 + cx + d = 0 has the general analytical R solution: x1 x2 = x 3 with K = 1.12 3ac b2 b 9a2 K 3a K 3ac b2 b 3 = + +i 2 18a2 K 3a 2 = 9abc 27da2 2b3 + 54a3 K K+ 3ac b2 9a2 K 3 4ac3 c2 b2 18abcd + 27a2 d2 + 4db3 18a2 1 /3 Primes A prime is a number I that can only be divided by itself and 1. There are an in nite number of primes. Proof: N suppose that the collection of primes P would be nite, than construct the number q = 1 + p, than holds p P q = 1(p) and so Q cannot be written as a product of primes from P . This is a contradiction. Mathematics Formulary by ir. J.C.A. Wevers 8 If (x) is the number of primes x, than holds: (x) = 1 and x x/ ln(x) lim lim (x) x x 2 =1 dt ln(t) For each N 2 there is a prime between N and 2N . The numbers Fk := 2k + 1 with k I are called Fermat numbers. Many Fermat numbers are prime. N The numbers Mk := 2k 1 are called Mersenne numbers. They occur when one searches for perfect numbers, which are numbers n I which are the sum of their different dividers, for example 6 = 1 + 2 + 3. There N are 23 Mersenne numbers for k < 12000 which are prime: for k {2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 1279, 2203, 2281, 3217, 4253, 4423, 9689, 9941, 11213}. To check if a given number n is prime one can use a sieve method. The rst known sieve method was developed by Eratosthenes. A faster method for large numbers are the 4 Fermat tests, who don t prove that a number is prime but give a large probability. 1. Take the rst 4 primes: b = {2, 3, 5, 7}, 2. Take w(b) = bn 1 mod n, for each b, 3. If w = 1 for each b, then n is probably prime. For each other value of w, n is certainly not prime. Chapter 2 Probability and statistics 2.1 Combinations The number of possible combinations of k elements from n elements is given by n k n! k !(n k )! = The number of permutations of p from n is given by n! n = p! (n p)! p The number of different ways to classify ni elements in i groups, when the total number of elements is N , is N! ni ! i 2.2 Probability theory The probability P (A) that an event A occurs is de ned by: P (A) = n(A) n(U ) where n(A) is the number of events when A occurs and n(U ) the total number of events. The probability P ( A) that A does not occur is: P ( A) = 1 P (A). The probability P (A B ) that A and B both occur is given by: P (A B ) = P (A) + P (B ) P (A B ). If A and B are independent, than holds: P (A B ) = P (A) P (B ). The probability P (A|B ) that A occurs, given the fact that B occurs, is: P (A B ) P (B ) P (A|B ) = 2.3 Statistics 2.3.1 General The average or mean value x of a collection of values is: x = distribution of x is given by: i xi /n. The standard deviation x in the n (xi x )2 x = i=1 n When samples are being used the sample variance s is given by s2 = 9 n 2 . n 1 Mathematics Formulary by ir. J.C.A. Wevers 10 The covariance xy of x and y is given by:: n (xi x )(yi y ) xy = i=1 n 1 The correlation coef cient rxy of x and y than becomes: rxy = xy / x y . The standard deviation in a variable f (x, y ) resulting from errors in x and y is: f x x 2 f (x,y) = 2 + f y y 2 + f f xy x y 2.3.2 Distributions 1. The Binomial distribution is the distribution describing a sampling with replacement. The probability for success is p. The probability P for k successes in n trials is then given by: P (x = k ) = The standard deviation is given by x = nk p (1 p)n k k np(1 p) and the expectation value is = np. 2. The Hypergeometric distribution is the distribution describing a sampling without replacement in which the order is irrelevant. The probability for k successes in a trial with A possible successes and B possible failures is then given by: A B k n k P (x = k ) = A+B n The expectation value is given by = nA/(A + B ). 3. The Poisson distribution is a limiting case of the binomial distribution when p 0, n and also np = is constant. x e P (x) = x! P (x) = 1. This distribution is normalized to x=0 4. The Normal distribution is a limiting case of the binomial distribution for continuous variables: P (x) = 1 1 exp 2 2 x x 2 5. The Uniform distribution occurs when a random number x is taken from the set a x b and is given by: P (x) = 1 x = 2 (b a) and 2 = (b a)2 . 12 1 if a x b b a P (x) = 0 in all other cases Chapter 2: Probability and statistics 11 6. The Gamma distribution is given by: P (x) = x 1 e x/ if 0 y ( ) with > 0 and > 0. The distribution has the following properties: x = , 2 = 2 . 7. The Beta distribution is given by: 1 (1 x) 1 P (x) = x if 0 x 1 ( , ) P (x) = 0 everywhere else and has the following properties: x = , 2 = . 2 ( + + 1) + ( + ) For P ( 2 ) holds: = V /2 and = 2. 8. The Weibull distribution is given by: P (x) = x 1 e x if 0 x > 0 P (x) = 0 in all other cases The average is x = 1/ (( + 1) ) 9. For a two-dimensional distribution holds: P1 (x1 ) = P (x1 , x2 )dx2 , P2 (x2 ) = P (x1 , x2 )dx1 with (g (x1 , x2 )) = g P g (x1 , x2 )P (x1 , x2 )dx1 dx2 = x1 2.4 x2 Regression analyses When there exists a relation between the quantities x and y of the form y = ax + b and there is a measured set xi with related yi , the following relation holds for a and b with x = (x1 , x2 , ..., xn ) and e = (1, 1, ..., 1): y ax be < x, e > From this follows that the inner products are 0: (y, x ) a(x, x ) b(e, x ) = 0 (y, e ) a(x, e ) b(e, e ) = 0 with (x, x ) = i x2 , (x, y ) = i xi yi , (x, e ) = i xi and (e, e ) = n. a and b follow from this. i A similar method works for higher order polynomial ts: for a second order t holds: y ax2 bx ce < x2 , x, e > with x2 = (x2 , ..., x2 ). n 1 The correlation coef cient r is a measure for the quality of a t. In case of linear regression it is given by: r= n (n x2 ( xy x x)2 )(n y y2 ( y )2 ) Chapter 3 Calculus 3.1 Integrals 3.1.1 Arithmetic rules The primitive function F (x) of f (x) obeys the rule F (x) = f (x). With F (x) the primitive of f (x) holds for the de nite integral b f (x)dx = F (b) F (a) a If u = f (x) holds: f ( b) b g (f (x))df (x) = a g (u)du f (a) Partial integration: with F and G the primitives of f and g holds: f (x) g (x)dx = f (x)G(x) G(x) df (x) dx dx A derivative can be brought under the intergral sign (see section 1.8.3 for the required conditions): x=h(y ) x=h(y ) d dy f (x, y ) dg (y ) dh(y ) dx f (g (y ), y ) + f (h(y ), y ) y dy dy f (x, y )dx = x=g (y ) x=g (y ) 3.1.2 Arc lengts, surfaces and volumes The arc length of a curve y (x) is given by: = dy (x) dx 1+ 2 dx The arc length of a parameter curve F (x(t)) is: = F ds = with t= (v, t)ds = F (x(t))|x(t)|dt dx x(t) = , |t | = 1 ds |x(t)| (v, t(t))dt = (v1 dx + v2 dy + v3 dz ) The surface A of a solid of revolution is: A = 2 y 1+ 12 dy (x) dx 2 dx Chapter 3: Calculus 13 The volume V of a solid of revolution is: f 2 (x)dx V = 3.1.3 Separation of quotients Every rational function P (x)/Q(x) where P and Q are polynomials can be written as a linear combination of functions of the type (x a)k with k Z , and of functions of the type Z px + q ((x a)2 + b2 )n with b > 0 and n I . So: N p(x) = (x a)n n k=1 p(x) = ((x b)2 + c2 )n Ak , (x a)k n k=1 Ak x + B ((x b)2 + c2 )k Recurrent relation: for n = 0 holds: (x2 dx 1 2n 1 x = + n+1 2 + 1)n + 1) 2n (x 2n (x2 dx + 1)n 3.1.4 Special functions Elliptic functions Elliptic functions can be written as a power series as follows: 1 k 2 sin2 (x) = 1 (2n 1)!! k 2n sin2n (x) (2n)!!(2n 1) n=1 1 =1+ 1 k 2 sin2 (x) (2n 1)!! 2n 2n k sin (x) (2n)!! n=1 with n!! = n(n 2)!!. The Gamma function The gamma function (y ) is de ned by: e x xy 1 dx (y ) = 0 One can derive that (y + 1) = y (y ) = y !. This is a way to de ne faculties for non-integers. Further one can derive that ( n) 1 (n + 2 ) = n (2n 1)!! and (y ) = e x xy 1 lnn (x)dx 2 0 The Beta function The betafunction (p, q ) is de ned by: 1 xp 1 (1 x)q 1 dx (p, q ) = 0 with p and q > 0. The beta and gamma functions are related by the following equation: (p, q ) = (p) (q ) (p + q ) Mathematics Formulary by ir. J.C.A. Wevers 14 The Delta function The delta function (x) is an in nitely thin peak function with surface 1. It can be de ned by: (x) = lim P ( , x) with P ( , x) = 0 0 for |x| > 1 when |x| < 2 Some properties are: (x)dx = 1 , F (x) (x)dx = F (0) 3.1.5 Goniometric integrals When solving goniometric integrals it can be useful to change variables. The following holds if one de nes 1 tan( 2 x) := t: 1 t2 2t 2dt , cos(x) = , sin(x) = dx = 1 + t2 1 + t2 1 + t2 Each integral of the type R(x, ax2 + bx + c)dx can be converted into one of the types that were treated in section 3.1.3. After this conversion one can substitute in the integrals of the type: d of cos( ) R(x, x2 + 1)dx : x = tan( ) , dx = x2 + 1 = t + x R(x, 1 x2 )dx : x = sin( ) , dx = cos( )d of R(x, x2 1)dx : x= 1 sin( ) , dx = d of cos( ) cos2 ( ) 1 x2 = 1 tx x2 1 = x t These de nite integrals are easily solved: /2 cosn (x) sinm (x)dx = (n 1)!!(m 1)!! (m + n)!! /2 when m and n are both even 1 in all other cases 0 Some important integrals are: xdx 2 = , ax + 1 e 12a2 2 x2 dx = , x + 1)2 (e 3 0 3.2 x3 dx 4 = x+1 e 15 0 Functions with more variables 3.2.1 Derivatives The partial derivative with respect to x of a function f (x, y ) is de ned by: f x = lim x0 h 0 f (x0 + h, y0 ) f (x0 , y0 ) h The directional derivative in the direction of is de ned by: f (x0 + r cos( ), y0 + r sin( )) f (x0 , y0 ) f = lim = ( f , (sin , cos )) = r 0 r f v |v | Chapter 3: Calculus 15 When one changes to coordinates f (x(u, v ), y (u, v )) holds: f f x f y = + u x u y u If x(t) and y (t) depend only on one parameter t holds: f dx f dy f = + t x dt y dt The total differential df of a function of 3 variables is given by: df = f f f dx + dy + dz x y z So f f dy f dz df = + + dx x y dx z dx The tangent in point x0 at the surface f (x, y ) = 0 is given by the equation fx (x0 )(x x0 ) + fy (x0 )(y y0 ) = 0. The tangent plane in x0 is given by: fx (x0 )(x x0 ) + fy (x0 )(y y0 ) = z f (x0 ). 3.2.2 Taylor series A function of two variables can be expanded as follows in a Taylor series: n f (x0 + h, y0 + k ) = 1 p! p=0 h p p +k p p x y f (x0 , y0 ) + R(n) with R(n) the residual error and h p p +k p p x y p f (a, b) = m=0 p m p m p f (a, b) hk m xm y p m 3.2.3 Extrema When f is continuous on a compact boundary V there exists a global maximum and a global minumum for f on this boundary. A boundary is called compact if it is limited and closed. Possible extrema of f (x, y ) on a boundary V I 2 are: R 1. Points on V where f (x, y ) is not differentiable, 2. Points where f = 0, 3. If the boundary V is given by (x, y ) = 0, than all points where f (x, y ) + (x, y ) = 0 are possible for extrema. This is the multiplicator method of Lagrange, is called a multiplicator. The same as in I 2 holds in I 3 when the area to be searched is constrained by a compact V , and V is de ned by R R 1 (x, y, z ) = 0 and 2 (x, y, z ) = 0 for extrema of f (x, y, z ) for points (1) and (2). Point (3) is rewritten as follows: possible extrema are points where f (x, y, z ) + 1 1 (x, y, z ) + 2 2 (x, y, z ) = 0. Mathematics Formulary by ir. J.C.A. Wevers 16 3.2.4 The -operator In cartesian coordinates (x, y, z ) holds: = gradf = div a = curl a = 2 f = ex + ey + ez x y z f f f ex + ey + ez x y z ax ay az + + x y z az ay ax az ex + y z z x 2 2 2 f f f + 2+ 2 2 x y z ey + ay ax x y ez In cylindrical coordinates (r, , z ) holds: = gradf = div a = curl a = 2 f = 1 er + e + ez r r z f 1 f f er + e + ez r r z ar 1 a az ar + + + r r r z a ar az 1 az er + r z z r 2 2 2 f 1 f 1 f f + +2 +2 r2 r r r 2 z e + a a 1 ar + r r r ez In spherical coordinates (r, , ) holds: = gradf = div a = curl a = 2 f = 1 1 er + e + e r r r sin 1 f 1 f f er + e + e r r r sin ar 2ar 1 a a 1 a + + + + r r r r tan r sin 1 a a 1 a 1 ar a a + er + r r tan r sin r sin r r a a 1 ar + e r r r 2 f 1 2f 1 f 1 2f 2f + + 2 2+ 2 +2 2 2 r r r r r tan r sin 2 e + General orthonormal curvilinear coordinates (u, v, w) can be derived from cartesian coordinates by the transformation x = x(u, v, w). The unit vectors are given by: eu = 1 x 1 x 1 x , ev = , ew = h1 u h2 v h3 w where the terms hi give normalization to length 1. The differential operators are than given by: gradf = 1 f 1 f 1 f eu + ev + ew h1 u h2 v h3 w Chapter 3: Calculus 17 1 (h2 h3 au ) + (h3 h1 av ) + (h1 h2 aw ) h1 h2 h3 u v w 1 (h3 aw ) (h2 av ) 1 (h1 au ) (h3 aw ) eu + h2 h3 v w h3 h1 w u 1 (h2 av ) (h1 au ) ew h1 h2 u v h2 h3 f h3 h1 f h1 h2 f 1 + + h1 h2 h3 u h1 u v h2 v w h3 w div a = curl a = 2 f = Some properties of the ev + -operator are: div( v ) = divv + grad v div(u v ) = v (curlu) u (curlv ) div grad = 2 curl( v ) = curlv + (grad ) v curl curlv = grad divv 2 v 2 v ( 2 v1 , 2 v2 , 2 v3 ) curl grad = 0 div curlv = 0 Here, v is an arbitrary vector eld and an arbitrary scalar eld. 3.2.5 Integral theorems Some important integral theorems are: (v n)d2 A = Gauss: (divv )d3 V Stokes for a scalar eld: ( et )ds = (n grad )d2 A Stokes for a vector eld: (v et )ds = (curlv n)d2 A this gives: (curlv n)d2 A = 0 Ostrogradsky: (n v )d2 A = ( n )d2 A = Here the orientable surface (curlv )d3 A (grad )d3 V d2 A is bounded by the Jordan curve s(t). 3.2.6 Multiple integrals Let A be a closed curve given by f (x, y ) = 0, than the surface A inside the curve in I 2 is given by R A= d2 A = dxdy Let the surface A be de ned by the function z = f (x, y ). The volume V bounded by A and the xy plane is than given by: V= f (x, y )dxdy The volume inside a closed surface de ned by z = f (x, y ) is given by: V= d3 V = f (x, y )dxdy = dxdydz Mathematics Formulary by ir. J.C.A. Wevers 18 3.2.7 Coordinate transformations The expressions d2 A and d3 V transform as follows when one changes coordinates to u = (u, v, w) through the transformation x(u, v, w): V= f (x, y, z )dxdydz = In I 2 holds: R x = u f (x(u)) xu yu x dudvdw u xv yv Let the surface A be de ned by z = F (x, y ) = X (u, v ). Than the volume bounded by the xy plane and F is given by: X X f (x)d2 A = f (x(u)) dudv = f (x, y, F (x, y )) 1 + x F 2 + y F 2 dxdy u v S 3.3 G G Orthogonality of functions The inner product of two functions f (x) and g (x) on the interval [a, b] is given by: b (f, g ) = f (x)g (x)dx a or, when using a weight function p(x), by: b (f, g ) = p(x)f (x)g (x)dx a The norm f follows from: f 2 = (f, f ). A set functions fi is orthonormal if (fi , fj ) = ij . Each function f (x) can be written as a sum of orthogonal functions: f (x) = ci gi (x) i=0 and c2 f i 2 . Let the set gi be orthogonal, than it follows: ci = 3.4 f, gi (gi , gi ) Fourier series Each function can be written as a sum of independent base functions. When one chooses the orthogonal basis (cos(nx), sin(nx)) we have a Fourier series. A periodical function f (x) with period 2L can be written as: f (x) = a0 + an cos n=1 n x n x + bn sin L L Due to the orthogonality follows for the coef cients: L a0 = 1 2L L f (t)dt , an = L 1 L L f (t) cos L n t L dt , bn = 1 L f (t) sin L n t L dt Chapter 3: Calculus 19 A Fourier series can also be written as a sum of complex exponents: cn einx f (x) = n= with 1 cn = 2 f (x)e inx dx The Fourier transform of a function f (x) gives the transformed function f ( ): 1 f ( ) = 2 f (x)e i x dx The inverse transformation is given by: 1 1 f (x+ ) + f (x ) = 2 2 f ( )ei x d where f (x+ ) and f (x ) are de ned by the lower - and upper limit: f (a ) = lim f (x) , f (a+ ) = lim f (x) x a For continuous functions is 1 2 [f (x+ ) + f (x )] = f (x). x a Chapter 4 Differential equations 4.1 Linear differential equations 4.1.1 First order linear DE The general solution of a linear differential equation is given by yA = yH + yP , where yH is the solution of the homogeneous equation and yP is a particular solution. A rst order differential equation is given by: y (x) + a(x)y (x) = b(x). Its homogeneous equation is y (x) + a(x)y (x) = 0. The solution of the homogeneous equation is given by yH = k exp a(x)dx Suppose that a(x) = a =constant. Substitution of exp( x) in the homogeneous equation leads to the characteristic equation + a = 0 = a. Suppose b(x) = exp( x). Than one can distinguish two cases: 1. = : a particular solution is: yP = exp( x) 2. = : a particular solution is: yP = x exp( x) When a DE is solved by variation of parameters one writes: yP (x) = yH (x)f (x), and than one solves f (x) from this. 4.1.2 Second order linear DE A differential equation of the second order with constant coef cients is given by: y (x) + ay (x) + by (x) = c(x). If c(x) = c =constant there exists a particular solution yP = c/b. Substitution of y = exp( x) leads to the characteristic equation 2 + a + b = 0. There are now 2 possibilities: 1. 1 = 2 : than yH = exp( 1 x) + exp( 2 x). 2. 1 = 2 = : than yH = ( + x) exp( x). If c(x) = p(x) exp( x) where p(x) is a polynomial there are 3 possibilities: 1. 1 , 2 = : yP = q (x) exp( x). 2. 1 = , 2 = : yP = xq (x) exp( x). 3. 1 = 2 = : yP = x2 q (x) exp( x). where q (x) is a polynomial of the same order as p(x). x When: y (x) + 2 y (x) = f (x) and y (0) = y (0) = 0 follows: y (x) = f (x) sin( (x t))dt. 0 20 Chapter 4: Di erential equations 21 4.1.3 The Wronskian We start with the LDE y (x) + p(x)y (x) + q (x)y (x) = 0 and the two initial conditions y (x0 ) = K0 and y (x0 ) = K1 . When p(x) and q (x) are continuous on the open interval I there exists a unique solution y (x) on this interval. The general solution can than be written as y (x) = c1 y1 (x) + c2 y2 (x) and y1 and y2 are linear independent. These are also all solutions of the LDE. The Wronskian is de ned by: W (y1 , y2 ) = y1 y1 y2 y2 = y1 y2 y2 y1 y1 and y2 are linear independent if and only if on the interval I when x0 I so that holds: W (y1 (x0 ), y2 (x0 )) = 0. 4.1.4 Power series substitution When a series y = leads to: an xn is substituted in the LDE with constant coef cients y (x) + py (x) + qy (x) = 0 this n(n 1)an xn 2 + pnan xn 1 + qan xn = 0 n Setting coef cients for equal powers of x equal gives: (n + 2)(n + 1)an+2 + p(n + 1)an+1 + qan = 0 This gives a general relation between the coef cients. Special cases are n = 0, 1, 2. 4.2 Some special cases 4.2.1 Frobenius method Given the LDE d2 y (x) b(x) dy (x) c(x) + + 2 y (x) = 0 dx2 x dx x with b(x) and c(x) analytical at x = 0. This LDE has at least one solution of the form an xn with i = 1, 2 yi (x) = xri n=0 with r real or complex and chosen so that a0 = 0. When one expands b(x) and c(x) as b(x) = b0 + b1 x + b2 x2 + ... and c(x) = c0 + c1 x + c2 x2 + ..., it follows for r: r2 + (b0 1)r + c0 = 0 There are now 3 possibilities: 1. r1 = r2 : than y (x) = y1 (x) ln |x| + y2 (x). 2. r1 r2 I : than y (x) = ky1 (x) ln |x| + y2 (x). N 3. r1 r2 = Z : than y (x) = y1 (x) + y2 (x). Z Mathematics Formulary by ir. J.C.A. Wevers 22 4.2.2 Euler Given the LDE d2 y (x) dy (x) + ax + by (x) = 0 2 dx dx Substitution of y (x) = xr gives an equation for r: r2 + (a 1)r + b = 0. From this one gets two solutions r1 and r2 . There are now 2 possibilities: x2 1. r1 = r2 : than y (x) = C1 xr1 + C2 xr2 . 2. r1 = r2 = r: than y (x) = (C1 ln(x) + C2 )xr . 4.2.3 Legendre s DE Given the LDE dy (x) d2 y (x) 2x + n(n 1)y (x) = 0 2 dx dx The solutions of this equation are given by y (x) = aPn (x) + by2 (x) where the Legendre polynomials P (x) are de ned by: dn (1 x2 )n Pn (x) = n dx 2n n! (1 x2 ) For these holds: Pn 2 = 2/(2n + 1). 4.2.4 The associated Legendre equation This equation follows from the -dependent part of the wave equation = cos( ). Than follows: (1 2 ) d d (1 2 ) dP ( ) d 2 = 0 by substitution of + [C (1 2 ) m2 ]P ( ) = 0 Regular solutions exists only if C = l(l + 1). They are of the form: |m| Pl |m| For |m| > l is Pl ( ) = (1 2 )m/2 d|m| P 0 ( ) (1 2 )|m|/2 d|m|+l 2 = ( 1)l 2l l! d |m| d |m|+l ( ) = 0. Some properties of Pl0 ( ) zijn: 1 Pl0 ( )Pl0 ( )d = 2 ll 2l + 1 1 Pl0 ( )tl = , l=0 1 1 2 t + t2 This polynomial can be written as: Pl0 ( ) 1 = ( + 2 1 cos( ))l d 0 4.2.5 Solutions for Bessel s equation Given the LDE dy (x) d2 y (x) +x + (x2 2 )y (x) = 0 dx2 dx also called Bessel s equation, and the Bessel functions of the rst kind x2 J (x) = x m=0 ( 1)m x2m + m + 1) 22m+ m! ( Chapter 4: Di erential equations 23 for := n I this becomes: N Jn (x) = xn m=0 ( 1)m x2m + m)! 22m+n m!(n When = Z the solution is given by y (x) = aJ (x) + bJ (x). But because for n Z holds: Z Z J n (x) = ( 1)n Jn (x), this does not apply to integers. The general solution of Bessel s equation is given by y (x) = aJ (x) + bY (x), where Y are the Bessel functions of the second kind: Y (x) = J (x) cos( ) J (x) and Yn (x) = lim Y (x) n sin( ) The equation x2 y (x) + xy (x) (x2 + 2 )y (x) = 0 has the modi ed Bessel functions of the rst kind I (x) = i J (ix) as solution, and also solutions K = [I (x) I (x)]/[2 sin( )]. Sometimes it can be convenient to write the solutions of Bessel s equation in terms of the Hankel functions (1) (2) Hn (x) = Jn (x) + iYn (x) , Hn (x) = Jn (x) iYn (x) 4.2.6 Properties of Bessel functions Bessel functions are orthogonal with respect to the weight function p(x) = x. J n (x) = ( 1)n Jn (x). The Neumann functions Nm (x) are de nied as: Nm (x) = 1 1 Jm (x) ln(x) + m 2 x n x2n n=0 The following holds: lim Jm (x) = xm , lim Nm (x) = x m for m = 0, lim N0 (x) = ln(x). x 0 lim H (r) = r x 0 e ikr ei t , r x 0 lim Jn (x) = x 2 cos(x xn ) , x lim J n (x) = x 2 sin(x xn ) x 1 with xn = 2 (n + 1 ). 2 Jn+1 (x) + Jn 1 (x) = 2n dJn (x) Jn (x) , Jn+1 (x) Jn 1 (x) = 2 x dx The following integral relations hold: 2 1 Jm (x) = 2 1 exp[i(x sin( ) m )]d = 0 cos(x sin( ) m )d 0 4.2.7 Laguerre s equation Given the LDE x d2 y (x) dy (x) + (1 x) + ny (x) = 0 dx2 dx Solutions of this equation are the Laguerre polynomials Ln (x): Ln (x) = ex dn ( 1)m n m xn e x = x n n! dx m! m m=0 Mathematics Formulary by ir. J.C.A. Wevers 24 4.2.8 The associated Laguerre equation Given the LDE d2 y (x) + dx2 m+1 1 x dy (x) + dx n + 1 (m + 1) 2 x y (x) = 0 Solutions of this equation are the associated Laguerre polynomials Lm (x): n Lm (x) = n ( 1)m n! x m dn m ex e x xn (n m)! dxn m 4.2.9 Hermite The differential equations of Hermite are: dHn (x) dHen (x) d2 Hen (x) d2 Hn (x) 2x x + 2nHn (x) = 0 and + nHen (x) = 0 2 2 dx dx dx dx Solutions of these equations are the Hermite polynomials, given by: Hn (x) = ( 1)n exp 12 x 2 Hen (x) = ( 1)n (exp x2 1 dn (exp( 2 x2 )) = 2n/2 Hen (x 2) n dx dn (exp( x2 )) = 2 n/2 Hn (x/ 2) n dx 4.2.10 Chebyshev The LDE (1 x2 ) d2 Un (x) dUn (x) 3x + n(n + 2)Un (x) = 0 dx2 dx has solutions of the form Un (x) = The LDE (1 x2 ) sin[(n + 1) arccos(x)] 1 x2 d2 Tn (x) dTn (x) x + n2 Tn (x) = 0 dx2 dx has solutions Tn (x) = cos(n arccos(x)). 4.2.11 Weber The LDE Wn (x) + (n + 4.3 1 2 1 1 x2 )Wn (x) = 0 has solutions: Wn (x) = Hen (x) exp( 4 x2 ). 4 Non-linear differential equations Some non-linear differential equations and a solution are: = a y 2 + b2 = a y 2 b2 = a b2 y 2 = a(y 2 + b2 ) = a(y 2 b2 ) = a(b2 y 2 ) b y y = ay b y y y y y y = b sinh(a(x x0 )) = b cosh(a(x x0 )) = b cos(a(x x0 )) = b tan(a(x x0 )) = b coth(a(x x0 )) = b tanh(a(x x0 )) b y= 1 + Cb exp( ax) y y y y y y Chapter 4: Di erential equations 4.4 25 Sturm-Liouville equations Sturm-Liouville equations are second order LDE s of the form: d dx p(x) dy (x) dx + q (x)y (x) = m(x)y (x) The boundary conditions are chosen so that the operator L= d dx p(x) d dx + q (x) is Hermitean. The normalization function m(x) must satisfy b m(x)yi (x)yj (x)dx = ij a When y1 (x) and y2 (x) are two linear independent solutions one can write the Wronskian in this form: W (y1 , y2 ) = y1 y1 y2 y2 = C p(x) where C is constant. By changing to another dependent variable u(x), given by: u(x) = y (x) p(x), the LDE transforms into the normal form: d2 u(x) 1 + I (x)u(x) = 0 with I (x) = 2 dx 4 p (x) p(x) 2 1 p (x) q (x) m(x) 2 p(x) p(x) If I (x) > 0, than y /y < 0 and the solution has an oscillatory behaviour, if I (x) < 0, than y /y > 0 and the solution has an exponential behaviour. 4.5 Linear partial differential equations 4.5.1 General The normal derivative is de ned by: u = ( u, n) n A frequently used solution method for PDE s is separation of variables: one assumes that the solution can be written as u(x, t) = X (x)T (t). When this is substituted two ordinary DE s for X (x) and T (t) are obtained. 4.5.2 Special cases The wave equation The wave equation in 1 dimension is given by 2u 2u = c2 2 t2 x When the initial conditions u(x, 0) = (x) and u(x, 0)/ t = (x) apply, the general solution is given by: x+ct 1 1 u(x, t) = [ (x + ct) + (x ct)] + 2 2c ( )d x ct Mathematics Formulary by ir. J.C.A. Wevers 26 The diffusion equation The diffusion equation is: u =D t 2 u Its solutions can be written in terms of the propagators P (x, x , t). These have the property that P (x, x , 0) = (x x ). In 1 dimension it reads: (x x )2 4Dt 1 exp P (x, x , t) = 2 Dt In 3 dimensions it reads: 1 exp 8( Dt)3/2 P (x, x , t) = (x x )2 4Dt With initial condition u(x, 0) = f (x) the solution is: u(x, t) = f (x )P (x, x , t)dx G The solution of the equation 2u u D 2 = g (x, t) t x is given by u(x, t) = dx g (x , t )P (x, x , t t ) dt The equation of Helmholtz The equation of Helmholtz is obtained by substitution of u(x, t) = v (x) exp(i t) in the wave equation. This gives for v : 2 v (x, ) + k 2 v (x, ) = 0 This gives as solutions for v : 1. In cartesian coordinates: substitution of v = A exp(ik x ) gives: v (x ) = A(k )eik x dk with the integrals over k 2 = k 2 . 2. In polar coordinates: (Am Jm (kr) + Bm Nm (kr))eim v (r, ) = m=0 3. In spherical coordinates: l 1 [Alm Jl+ 2 (kr) + Blm J l 1 (kr)] 2 v (r, , ) = l=0 m= l Y ( , ) r Chapter 4: Di erential equations 27 4.5.3 Potential theory and Green s theorem Subject of the potential theory are the Poisson equation 2 u = f (x ) where f is a given function, and the Laplace equation 2 u = 0. The solutions of these can often be interpreted as a potential. The solutions of Laplace s equation are called harmonic functions. When a vector eld v is given by v = grad holds: b (v, t )ds = (b ) (a ) a In this case there exist functions and w so that v = grad + curlw. The eld lines of the eld v (x ) follow from: x (t) = v (x ) The rst theorem of Green is: [u 2 v + ( u, v )]d3 V = u v 2 dA n S G The second theorem of Green is: [u 2 v v 2 u]d3 V = G u v u v n n d2 A S A harmonic function which is 0 on the boundary of an area is also 0 within that area. A harmonic function with a normal derivative of 0 on the boundary of an area is constant within that area. The Dirichlet problem is: 2 u(x ) = f (x ) , x R , u(x ) = g (x ) for all x S. It has a unique solution. The Neumann problem is: 2 u(x ) = f (x ) , x R , u(x ) = h(x ) for all x S. n The solution is unique except for a constant. The solution exists if: f (x )d3 V = R h(x )d2 A S A fundamental solution of the Laplace equation satis es: 2 u(x ) = (x ) This has in 2 dimensions in polar coordinates the following solution: u(r) = ln(r) 2 This has in 3 dimensions in spherical coordinates the following solution: u(r) = 1 4 r Mathematics Formulary by ir. J.C.A. Wevers 28 The equation 2 v = (x ) has the solution v (x ) = 1 4 |x | After substituting this in Green s 2nd theorem and applying the sieve property of the function one can derive Green s 3rd theorem: u( ) = 2 1 4 r R u d3 V + 1 u u r n n 1 4 1 r d2 A S The Green function G(x, ) is de ned by: 2 G = (x ), and on boundary S holds G(x, ) = 0. Than G can be written as: 1 + g (x, ) G(x, ) = 4 |x | Than g (x, ) is a solution of Dirichlet s problem. The solution of Poisson s equation boundary S holds: u(x ) = g (x ), is: G(x, )f (x )d3 V u( ) = R g (x ) S G(x, ) 2 dA n 2 u = f (x ) when on the Chapter 5 Linear algebra 5.1 Vector spaces G is a group for the operation if: 1. a, b G a b G : a group is closed. 2. (a b) c = a (b c): a group is associative. 3. e G so that a e = e a = a: there exists a unit element. 4. a G a G so that a a = e: each element has an inverse. If 5. a b = b a the group is called Abelian or commutative. Vector spaces form an Abelian group for addition and multiplication: 1 a = a, ( a) = ( )a, ( + )(a + b) = a + b + a + b. W is a linear subspace if w1 , w2 W holds: w1 + w2 W . W is an invariant subspace of V for the operator A if w W holds: Aw W . 5.2 Basis For an orthogonal basis holds: (ei , ej ) = c ij . For an orthonormal basis holds: (ei , ej ) = ij . The set vectors {an } is linear independent if: i ai = 0 i i = 0 i The set {an } is a basis if it is 1. independent and 2. V =< a1 , a2 , ... >= 5.3 i ai . Matrix calculus 5.3.1 Basic operations For the matrix multiplication of matrices A = aij and B = bkl holds with r the row index and k the column index: Ar1 k1 B r2 k2 = C r1 k2 , (AB )ij = aik bkj k where r is the number of rows and k the number of columns. The transpose of A is de ned by: aT = aji . For this holds (AB )T = B T AT and (AT ) 1 = (A 1 )T . For the ij inverse matrix holds: (A B ) 1 = B 1 A 1 . The inverse matrix A 1 has the property that A A 1 = I and can I be found by diagonalization: (Aij |I ) (I |A 1 ). I I ij 29 Mathematics Formulary by ir. J.C.A. Wevers 30 The inverse of a 2 2 matrix is: ab cd 1 = 1 ad bc d b c a The determinant function D = det(A) is de ned by: det(A) = D(a 1 , a 2 , ..., a n ) For the determinant det(A) of a matrix A holds: det(AB ) = det(A) det(B ). Een 2 2 matrix has determinant: det ab cd = ad cb The derivative of a matrix is a matrix with the derivatives of the coef cients: daij dAB dA dB dA = and =B +A dt dt dt dt dt The derivative of the determinant is given by: da1 da2 dan d det(A) = D( , ..., an ) + D(a1 , , ..., an ) + ... + D(a1 , ..., ) dt dt dt dt When the rows of a matrix are considered as vectors the row rank of a matrix is the number of independent vectors in this set. Similar for the column rank. The row rank equals the column rank for each matrix. Let A : V V be the complex extension of the real linear operator A : V V in a nite dimensional V . Then A and A have the same caracteristic equation. When Aij I and v1 + iv2 is an eigenvector of A at eigenvalue = 1 + i 2 , than holds: R 1. Av1 = 1 v1 2 v2 and Av2 = 2 v1 + 1 v2 . 2. v = v1 iv2 is an eigenvalue at = 1 i 2 . 3. The linear span < v1 , v2 > is an invariant subspace of A. If kn are the columns of A, than the transformed space of A is given by: R(A) =< Ae1 , ..., Aen >=< k1 , ..., kn > If the columns kn of a n m matrix A are independent, than the nullspace N (A) = {0 }. 5.3.2 Matrix equations We start with the equation A x=b and b = 0. If det(A) = 0 the only solution is 0. If det(A) = 0 there exists exactly one solution = 0. The equation A x=0 has exactly one solution = 0 if det(A) = 0, and if det(A) = 0 the solution is 0. Cramer s rule for the solution of systems of linear equations is: let the system be written as A x = b a1 x1 + ... + an xn = b then xj is given by: xj = D(a1 , ..., aj 1 , b, aj +1 , ..., an ) det(A) Chapter 5: Linear algebra 5.4 31 Linear transformations A transformation A is linear if: A( x + y ) = Ax + Ay . Some common linear transformations are: Transformation type Projection on the line < a > Projection on the plane (a, x ) = 0 Mirror image in the line < a > Mirror image in the plane (a, x ) = 0 Equation P (x ) = (a, x )a/(a, a ) Q(x ) = x P (x ) S (x ) = 2P (x ) x T (x ) = 2Q(x ) x = x 2P (x ) For a projection holds: x PW (x ) PW (x ) and PW (x ) W . If for a transformation A holds: (Ax, y ) = (x, Ay ) = (Ax, Ay ), than A is a projection. Let A : W W de ne a linear transformation; we de ne: If S is a subset of V : A(S ) := {Ax W |x S } If T is a subset of W : A (T ) := {x V |A(x ) T } Than A(S ) is a linear subspace of W and the inverse transformation A (T ) is a linear subspace of V . From this follows that A(V ) is the image space of A, notation: R(A). A (0 ) = E0 is a linear subspace of V , the null space of A, notation: N (A). Then the following holds: dim(N (A)) + dim(R(A)) = dim(V ) 5.5 Plane and line The equation of a line that contains the points a and b is: x = a + (b a ) = a + r The equation of a plane is: x = a + (b a ) + (c a ) = a + r1 + r2 When this is a plane in I 3 , the normal vector to this plane is given by: R nV = r1 r2 |r1 r2 | A line can also be described by the points for which the line equation : (a, x) + b = 0 holds, and for a plane V: (a, x) + k = 0. The normal vector to V is than: a/|a|. The distance d between 2 points p and q is given by d(p, q ) = p q . In I 2 holds: The distance of a point p to the line (a, x ) + b = 0 is R d(p, ) = |(a, p ) + b| |a| Similarly in I 3 : The distance of a point p to the plane (a, x ) + k = 0 is R d(p, V ) = |(a, p ) + k | |a| This can be generalized for I n and C n (theorem from Hesse). R Mathematics Formulary by ir. J.C.A. Wevers 32 5.6 Coordinate transformations The linear transformation A from I n I m is given by (I = I of C ): K K K R y = Am n x where a column of A is the image of a base vector in the original. The matrix A transforms a vector given w.r.t. a basis into a vector w.r.t. a basis . It is given by: A = ( (Aa1 ), ..., (Aan )) where (x ) is the representation of the vector x w.r.t. basis . The transformation matrix S transforms vectors from coordinate system into coordinate system : S := I = ( (a1 ), ..., (an )) I and S S = I I The matrix of a transformation A is than given by: A = A e1 , ..., A en For the transformation of matrix operators to another coordinate system holds: A = S A S , A = S A S and (AB ) = A B . Further is A = S A , A = A S . A vector is transformed via X = S X . 5.7 Eigen values The eigenvalue equation Ax = x with eigenvalues can be solved with (A I ) = 0 det(A I ) = 0. The eigenvalues follow from this I I characteristic equation. The following is true: det(A) = i and Tr(A) = aii = i . i i i The eigen values i are independent of the chosen basis. The matrix of A in a basis of eigenvectors, with S the transformation matrix to this basis, S = (E 1 , ..., E n ), is given by: = S 1 AS = diag( 1 , ..., n ) When 0 is an eigen value of A than E0 (A) = N (A). When is an eigen value of A holds: An x = n x. 5.8 Transformation types Isometric transformations A transformation is isometric when: Ax = x . This implies that the eigen values of an isometric transformation are given by = exp(i ) | | = 1. Than also holds: (Ax, Ay ) = (x, y ). When W is an invariant subspace if the isometric transformation A with dim(A) < , than also W is an invariante subspace. Chapter 5: Linear algebra 33 Orthogonal transformations A transformation A is orthogonal if A is isometric and the inverse A exists. For an orthogonal transformation O holds OT O = I , so: OT = O 1 . If A and B are orthogonal, than AB and A 1 are also orthogonal. I Let A : V V be orthogonal with dim(V ) < . Than A is: Direct orthogonal if det(A) = +1. A describes a rotation. A rotation in I 2 through angle is given by: R R= cos( ) sin( ) sin( ) cos( ) So the rotation angle is determined by Tr(A) = 2 cos( ) with 0 . Let 1 and 2 be the roots of the characteristic equation, than also holds: ( 1 ) = ( 2 ) = cos( ), and 1 = exp(i ), 2 = exp( i ). In I 3 holds: 1 = 1, 2 = = exp(i ). A rotation over E 1 is given by the matrix R 3 1 0 0 0 cos( ) sin( ) 0 sin( ) cos( ) Mirrored orthogonal if det(A) = 1. Vectors from E 1 are mirrored by A w.r.t. the invariant subspace E 1 . A 1 1 2 mirroring in I in < (cos( 2 ), sin( 2 )) > is given by: R S= cos( ) sin( ) sin( ) cos( ) Mirrored orthogonal transformations in I 3 are rotational mirrorings: rotations of axis < a1 > through angle and R mirror plane < a1 > . The matrix of such a transformation is given by: 1 0 0 0 cos( ) sin( ) 0 sin( ) cos( ) For all orthogonal transformations O in I 3 holds that O(x ) O(y ) = O(x y ). R I n (n < ) can be decomposed in invariant subspaces with dimension 1 or 2 for each orthogonal transformation. R Unitary transformations Let V be a complex space on which an inner product is de ned. Than a linear transformation U is unitary if U is isometric and its inverse transformation A exists. A n n matrix is unitary if U H U = I . It has determinant I | det(U )| = 1. Each isometric transformation in a nite-dimensional complex vector space is unitary. Theorem: for a n n matrix A the following statements are equivalent: 1. A is unitary, 2. The columns of A are an orthonormal set, 3. The rows of A are an orthonormal set. Symmetric transformations A transformation A on I n is symmetric if (Ax, y ) = (x, Ay ). A matrix A I n n is symmetric if A = AT . A R M linear operator is only symmetric if its matrix w.r.t. an arbitrary basis is symmetric. All eigenvalues of a symmetric transformation belong to I . The different eigenvectors are mutually perpendicular. If A is symmetric, than AT = R A = AH on an orthogonal basis. For each matrix B I m n holds: B T B is symmetric. M Mathematics Formulary by ir. J.C.A. Wevers 34 Hermitian transformations A transformation H : V V with V = C n is Hermitian if (Hx, y ) = (x, Hy ). The Hermitian conjugated transformation AH of A is: [aij ]H = [a ]. An alternative notation is: AH = A . The inner product of two vectors ji x and y can now be written in the form: (x, y ) = xH y . If the transformations A and B are Hermitian, than their product AB is Hermitian if: [A, B ] = AB BA = 0. [A, B ] is called the commutator of A and B . The eigenvalues of a Hermitian transformation belong to I . R A matrix representation can be coupled with a Hermitian operator L. W.r.t. a basis ei it is given by Lmn = (em , Len ). Normal transformations For each linear transformation A in a complex vector space V there exists exactly one linear transformation B so that (Ax, y ) = (x, By ). This B is called the adjungated transformation of A. Notation: B = A . The following holds: (CD) = D C . A = A 1 if A is unitary and A = A if A is Hermitian. De nition: the linear transformation A is normal in a complex vector space V if A A = AA . This is only the case if for its matrix S w.r.t. an orthonormal basis holds: A A = AA . If A is normal holds: 1. For all vectors x V and a normal transformation A holds: (Ax, Ay ) = (A Ax, y ) = (AA x, y ) = (A x, A y ) 2. x is an eigenvector of A if and only if x is an eigenvector of A . 3. Eigenvectors of A for different eigenvalues are mutually perpendicular. 4. If E if an eigenspace from A than the orthogonal complement E is an invariant subspace of A. Let the different roots of the characteristic equation of A be i with multiplicities ni . Than the dimension of each eigenspace Vi equals ni . These eigenspaces are mutually perpendicular and each vector x V can be written in exactly one way as xi with xi Vi x= i This can also be written as: xi = Pi x where Pi is a projection on Vi . This leads to the spectral mapping theorem: let A be a normal transformation in a complex vector space V with dim(V ) = n. Than: 1. There exist projection transformations Pi , 1 i p, with the properties Pi Pj = 0 for i = j , P1 + ... + Pp = I , I dimP1 (V ) + ... + dimPp (V ) = n and complex numbers 1 , ..., p so that A = 1 P1 + ... + p Pp . 2. If A is unitary than holds | i | = 1 i. 3. If A is Hermitian than i I i. R Chapter 5: Linear algebra 35 Complete systems of commuting Hermitian transformations Consider m Hermitian linear transformations Ai in a n dimensional complex inner product space V . Assume they mutually commute. Lemma: if E is the eigenspace for eigenvalue from A1 , than E is an invariant subspace of all transformations Ai . This means that if x E , than Ai x E . Theorem. Consider m commuting Hermitian matrices Ai . Than there exists a unitary matrix U so that all matrices U Ai U are diagonal. The columns of U are the common eigenvectors of all matrices Aj . If all eigenvalues of a Hermitian linear transformation in a n-dimensional complex vector space differ, than the normalized eigenvector is known except for a phase factor exp(i ). De nition: a commuting set Hermitian transformations is called complete if for each set of two common eigenvectors vi , vj there exists a transformation Ak so that vi and vj are eigenvectors with different eigenvalues of Ak . Usually a commuting set is taken as small as possible. In quantum physics one speaks of commuting observables. The required number of commuting observables equals the number of quantum numbers required to characterize a state. 5.9 Homogeneous coordinates Homogeneous coordinates are used if one wants to combine both rotations and translations in one matrix transformation. An extra coordinate is introduced to describe the non-linearities. Homogeneous coordinates are derived from cartesian coordinates as follows: X wx x Y wy y = = Z wz z cart w hom w hom so x = X/w, y = Y /w and z = Z/w. Transformations in homogeneous coordinates are described by the following matrices: 1. Translation along vector (X0 , Y0 , Z0 , w0 ): w0 0 T = 0 0 0 w0 0 0 0 0 w0 0 X0 Y0 Z0 w0 2. Rotations of the x, y, z axis, resp. through angles , , : 1 0 0 0 0 cos sin 0 Rx ( ) = 0 sin cos 0 Ry ( ) = 0 0 0 1 cos sin 0 sin cos 0 Rz ( ) = 0 0 1 0 0 0 cos 0 sin 0 0 0 0 1 0 sin 1 0 0 cos 0 0 0 0 0 1 3. A perspective projection on image plane z = c with the center of projection in the origin. This transformation has no inverse. 10 0 0 0 1 0 0 P (z = c) = 0 0 1 0 0 0 1/c 0 Mathematics Formulary by ir. J.C.A. Wevers 36 5.10 Inner product spaces A complex inner product on a complex vector space is de ned as follows: 1. (a, b ) = (b, a ), 2. (a, 1 b1 + 2 b 2 ) = 1 (a, b 1 ) + 2 (a, b 2 ) for all a, b1 , b2 V and 1 , 2 C . 3. (a, a ) 0 for all a V , (a, a ) = 0 if and only if a = 0. Due to (1) holds: (a, a ) I . The inner product space C n is the complex vector space on which a complex inner R product is de ned by: n a bi i (a, b ) = i=1 For function spaces holds: b f (t)g (t)dt (f, g ) = a For each a the length a is de ned by: a = (a, a ). The following holds: a b a + b a + b , and with the angle between a and b holds: (a, b ) = a b cos( ). Let {a1 , ..., an } be a set of vectors in an inner product space V . Than the Gramian G of this set is given by: Gij = (ai , aj ). The set of vectors is independent if and only if det(G) = 0. A set is orthonormal if (ai , aj ) = ij . If e1 , e2 , ... form an orthonormal row in an in nite dimensional vector space Bessel s inequality holds: x 2 |(ei , x )|2 i=1 xn x = 0. The equal sign holds if and only if lim n The inner product space 2 is de ned in C by: 2 = |an |2 < a = (a1 , a2 , ...) | n=1 A space is called a Hilbert space if it is 5.11 2 and if also holds: lim |an+1 an | = 0. n The Laplace transformation The class LT exists of functions for which holds: 1. On each interval [0, A], A > 0 there are no more than a nite number of discontinuities and each discontinuity has an upper - and lower limit, 2. t0 [0, > and a, M I so that for t t0 holds: |f (t)| exp( at) < M . R Than there exists a Laplace transform for f . The Laplace transformation is a generalisation of the Fourier transformation. The Laplace transform of a function f (t) is, with s C and t 0: f (t)e st dt F (s) = 0 Chapter 5: Linear algebra 37 The Laplace transform of the derivative of a function is given by: L f (n) (t) = f (n 1) (0) sf (n 2) (0) ... sn 1 f (0) + sn F (s) The operator L has the following properties: 1. Equal shapes: if a > 0 than L (f (at)) = 1 F a s a 2. Damping: L (e at f (t)) = F (s + a) 3. Translation: If a > 0 and g is de ned by g (t) = f (t a) if t > a and g (t) = 0 for t a, than holds: L (g (t)) = e sa L(f (t)). If s I than holds ( f ) = L( (f )) and ( f ) = L( (f )). R For some often occurring functions holds: f (t) = tn at e n! eat cos( t) F (s) = L(f (t)) = (s a) n 1 s a (s a)2 + 2 (s a)2 + 2 eat sin( t) (t a) 5.12 exp( as) The convolution The convolution integral is de ned by: t (f g )(t) = f (u)g (t u)du 0 The convolution has the following properties: 1. f g LT 2. L(f g ) = L(f ) L(g ) 3. Distribution: f (g + h) = f g + f h 4. Commutative: f g = g f 5. Homogenity: f ( g ) = f g If L(f ) = F1 F2 , than is f (t) = f1 f2 . 5.13 Systems of linear differential equations We start with the equation x = Ax. Assume that x = v exp( t), than follows: Av = v . In the 2 2 case holds: 1. 1 = 2 : than x(t) = vi exp( i t). 2. 1 = 2 : than x(t) = (ut + v ) exp( t). Mathematics Formulary by ir. J.C.A. Wevers 38 Assume that = + i is an eigenvalue with eigenvector v , than is also an eigenvalue for eigenvector v . Decompose v = u + iw, than the real solutions are c1 [u cos( t) w sin( t)]e t + c2 [v cos( t) + u sin( t)]e t There are two solution strategies for the equation x = Ax: 1. Let x = v exp( t) det(A 2 I ) = 0. I 2. Introduce: x = u and y = v , this leads to x = u and y = v . This transforms a n-dimensional set of second order equations into a 2n-dimensional set of rst order equations. 5.14 Quadratic forms 5.14.1 Quadratic forms in IR2 The general equation of a quadratic form is: xT Ax + 2xT P + S = 0. Here, A is a symmetric matrix. If = S 1 AS = diag( 1 , ..., n ) holds: uT u + 2uT P + S = 0, so all cross terms are 0. u = (u, v, w) should be chosen so that det(S ) = +1, to maintain the same orientation as the system (x, y, z ). Starting with the equation ax2 + 2bxy + cy 2 + dx + ey + f = 0 we have |A| = ac b2 . An ellipse has |A| > 0, a parabola |A| = 0 and a hyperbole |A| < 0. In polar coordinates this can be written as: ep r= 1 e cos( ) An ellipse has e < 1, a parabola e = 1 and a hyperbola e > 1. 5.14.2 Quadratic surfaces in IR3 Rank 3: x2 y2 z2 +q 2 +r 2 =d 2 a b c Ellipsoid: p = q = r = d = 1, a, b, c are the lengths of the semi axes. p Single-bladed hyperboloid: p = q = d = 1, r = 1. Double-bladed hyperboloid: r = d = 1, p = q = 1. Cone: p = q = 1, r = 1, d = 0. Rank 2: x2 y2 z +q 2 +r 2 =d a2 b c Elliptic paraboloid: p = q = 1, r = 1, d = 0. p Hyperbolic paraboloid: p = r = 1, q = 1, d = 0. Elliptic cylinder: p = q = 1, r = d = 0. Hyperbolic cylinder: p = d = 1, q = 1, r = 0. Pair of planes: p = 1, q = 1, d = 0. Rank 1: py 2 + qx = d Parabolic cylinder: p, q > 0. Parallel pair of planes: d > 0, q = 0, p = 0. Double plane: p = 0, q = d = 0. Chapter 6 Complex function theory 6.1 Functions of complex variables Complex function theory deals with complex functions of a complex variable. Some de nitions: f is analytical on G if f is continuous and differentiable on G . A Jordan curve is a curve that is closed and singular. If K is a curve in C with parameter equation z = (t) = x(t) + iy (t), a t b, than the length L of K is given by: b 2 dx dt L= dy dt + b b 2 dz dt = dt dt = a a a | (t)|dt The derivative of f in point z = a is: f (a) = lim z a f (z ) f (a) z a If f (z ) = u(x, y ) + iv (x, y ) the derivative is: f (z ) = u v u v +i = i + x x y y Setting both results equal yields the equations of Cauchy-Riemann: v u = , x y These equations imply that 6.2 2 u= 2 u v = y x v = 0. f is analytical if u and v satisfy these equations. Complex integration 6.2.1 Cauchy s integral formula Let K be a curve described by z = (t) on a t b and f (z ) is continuous on K . Than the integral of f over K is: b f ( (t)) (t)dt f (z )dz = f continuous = F (b) F (a) a K Lemma: let K be the circle with center a and radius r taken in a positive direction. Than holds for integer m: 1 2 i dz = (z a)m 0 if m = 1 1 if m = 1 K Theorem: if L is the length of curve K and if |f (z )| M for z K , than, if the integral exists, holds: f (z )dz M L K 39 Mathematics Formulary by ir. J.C.A. Wevers 40 z Theorem: let f be continuous on an area G and let p be a xed point of G. Let F (z ) = p f ( )d for all z G only depend on z and not on the integration path. Than F (z ) is analytical on G with F (z ) = f (z ). This leads to two equivalent formulations of the main theorem of complex integration: let the function f be analytical on an area G. Let K and K be two curves with the same starting - and end points, which can be transformed into each other by continous deformation within G. Let B be a Jordan curve. Than holds f (z )dz f (z )dz = K f (z )dz = 0 B K By applying the main theorem on eiz /z one can derive that sin(x) dx = x 2 0 6.2.2 Residue A point a C is a regular point of a function f (z ) if f is analytical in a. Otherwise a is a singular point or pole of f (z ). The residue of f in a is de ned by 1 2 i Res f (z ) = z =a f (z )dz K where K is a Jordan curve which encloses a in positive direction. The residue is 0 in regular points, in singular points it can be both 0 and = 0. Cauchy s residue proposition is: let f be analytical within and on a Jordan curve K except in a nite number of singular points ai within K . Than, if K is taken in a positive direction, holds: n 1 2 i f (z )dz = Res f (z ) k=1 K z =ak Lemma: let the function f be analytical in a, than holds: Res z =a f (z ) = f (a) z a This leads to Cauchy s integral theorem: if F is analytical on the Jordan curve K , which is taken in a positive direction, holds: f (z ) 1 f (a) if a inside K dz = 0 if a outside K 2 i z a K Theorem: let K be a curve (K need not be closed) and let ( ) be continuous on K . Than the function ( )d z f (z ) = K is analytical with n-th derivative ( )d ( z )n+1 f (n) (z ) = n! K Theorem: let K be a curve and G an area. Let ( , z ) be de ned for K , z G, with the following properties: 1. ( , z ) is limited, this means | ( , z )| M for K , z G, 2. For xed K , ( , z ) is an analytical function of z on G, Chapter 6: Complex function theory 41 3. For xed z G the functions ( , z ) and ( , z )/ z are continuous functions of on K . Than the function f (z ) = ( , z )d K is analytical with derivative ( , z ) d z f (z ) = K Cauchy s inequality: let f (z ) be an analytical function within and on the circle C : |z a| = R and let |f (z )| M for z C . Than holds M n! f (n) (a) n R 6.3 Analytical functions de nied by series The series fn (z ) is called pointwise convergent on an area G with sum F (z ) if N >0 z G N0 I n>n0 R f (z ) fn (z ) < n=1 The series is called uniform convergent if N >0 N0 I n>n0 z G R f (z ) fn (z ) < n=1 Uniform convergence implies pointwise convergence, the opposite is not necessary. an z n have a radius of convergence R. R is the distance to the rst non-essential Theorem: let the power series n=0 singularity. If lim n n |an | = L exists, than R = 1/L. If lim |an+1 |/|an | = L exists, than R = 1/L. n If these limits both don t exist one can nd R with the formula of Cauchy-Hadamard: 1 = lim sup n |an | R n 6.4 Laurent series Taylor s theorem: let f be analytical in an area G and let point a G has distance r to the boundary of G. Than f (z ) can be expanded into the Taylor series near a: cn (z a)n with cn = f (z ) = n=0 f (n) (a) n! valid for |z a| < r. The radius of convergence of the Taylor series is r. If f has a pole of order k in a than c1 , ..., ck 1 = 0, ck = 0. Theorem of Laurent: let f be analytical in the circular area G : r < |z a| < R. Than f (z ) can be expanded into a Laurent series with center a: cn (z a)n with cn = f (z ) = n= f (w)dw , n Z Z (w a)n+1 1 2 i K Mathematics Formulary by ir. J.C.A. Wevers 42 valid for r < |z a| < R and K an arbitrary Jordan curve in G which encloses point a in positive direction. The principal part of a Laurent series is: c n (z a) n . One can classify singular points with this. There are 3 n=1 cases: 1. There is no principal part. Than a is a non-essential singularity. De ne f (a) = c0 and the series is also valid for |z a| < R and f is analytical in a. 2. The principal part contains a nite number of terms. Than there exists a k I so that N lim (z a)k f (z ) = c k = 0. Than the function g (z ) = (z a)k f (z ) has a non-essential singularity in a. z a One speaks of a pole of order k in z = a. 3. The principal part contains an in nite number of terms. Then, a is an essential singular point of f , such as exp(1/z ) for z = 0. If f and g are analytical, f (a) = 0, g (a) = 0, g (a) = 0 than f (z )/g (z ) has a simple pole (i.e. a pole of order 1) in z = a with f (a) f (z ) = Res z =a g (z ) g (a) 6.5 Jordan s theorem + Residues are often used when solving de nite integrals. We de ne the notations C = {z ||z | = , (z ) 0} and + C = {z ||z | = , (z ) 0} and M ( , f ) = max |f (z )|, M ( , f ) = max |f (z )|. We assume that f (z ) is z C + z C analytical for (z ) > 0 with a possible exception of a nite number of singular points which do not lie on the real axis, lim M + ( , f ) = 0 and that the integral exists, than f (x)dx = 2 i Resf (z ) in (z ) > 0 Replace M + by M in the conditions above and it follows that: f (x)dx = 2 i Resf (z ) in (z ) < 0 Jordan s lemma: let f be continuous for |z | R, (z ) 0 and lim M + ( , f ) = 0. Than holds for > 0 lim f (z )ei z dz = 0 + C Let f be continuous for |z | R, (z ) 0 and lim M ( , f ) = 0. Than holds for < 0 lim f (z )ei z dz = 0 C Let z = a be a simple pole of f (z ) and let C be the half circle |z a| = , 0 arg(z a) , taken from a + to a . Than is 1 1 lim f (z )dz = 2 Res f (z ) z =a 0 2 i C Chapter 7 Tensor calculus 7.1 Vectors and covectors A nite dimensional vector space is denoted by V , W . The vector space of linear transformations from V to W is denoted by L(V , W ). Consider L(V ,I ) := V . We name V the dual space of V . Now we can de ne vectors in V R with basis c and covectors in V with basis . Properties of both are: c 1. Vectors: x = xi ci with basis vectors ci : ci = xi Transformation from system i to i is given by: ci = Ai ci = i V , xi = Ai xi i i i i 2. Covectors: x = xi with basis vectors c c i = dxi c Transformation from system i to i is given by: i = Ai i V , xi = Ai xi c ic i Here the Einstein convention is used: ai bi := ai bi i The coordinate transformation is given by: Ai = i xi xi , Ai = i i x xi k From this follows that Ai Ak = l and Ai = (Ai ) 1 . i i k l In differential notation the coordinate transformations are given by: dxi = xi i dx xi and xi = i x xi xi The general transformation rule for a tensor T is: q1 ...qn Ts1 ...sm = x u uq1 uqn xr1 xrm p ...pn pn sm Tr11...rm p1 s1 x x u u For an absolute tensor = 0. 43 Mathematics Formulary by ir. J.C.A. Wevers 44 7.2 Tensor algebra The following holds: aij (xi + yi ) aij xi + aij yi , but: aij (xi + yj ) aij xi + aij yj and (aij + aji )xi xj 2aij xi xj , but: (aij + aji )xi yj 2aij xi yj en (aij aji )xi xj 0. p The sum and difference of two tensors is a tensor of the same rank: Ap Bq . The outer tensor product results in q pr m prm a tensor with a rank equal to the sum of the ranks of both tensors: Aq Bs = Cqs . The contraction equals two mpr mp indices and sums over them. Suppose we take r = s for a tensor Aqs , this results in: Ampr = Bq . The inner qr r product of two tensors is de ned by taking the outer product followed by a contraction. 7.3 Inner product De nition: the bilinear transformation B : V V I , B (x, y ) = y (x ) is denoted by < x, y >. For this pairing R operator < , >= holds: y (x) =< x, y >= yi xi , < c i , cj >= i j Let G : V V be a linear bijection. De ne the bilinear forms g :V V I R g (x, y ) =< x, Gy > h(x, y ) =< G 1 x, y > h:V V I R Both are not degenerated. The following holds: h(Gx, Gy ) =< x, Gy >= g (x, y ). If we identify V and V with G, than g (or h) gives an inner product on V . The inner product (, ) on k (V ) is de ned by: ( , ) = 1 0 ( , )Tk (V ) k! The inner product of two vectors is than given by: (x, y ) = xi y i < ci , Gcj >= gij xi xj The matrix gij of G is given by j gij = Gci c The matrix g ij of G 1 is given by: g kl cl = G 1 c k k For this metric tensor gij holds: gij g jk = i . This tensor can raise or lower indices: xj = gij xi , xi = g ij xj i and dui = = g ij cj . c Chapter 7: Tensor calculus 7.4 45 Tensor product De nition: let U and V be two nite dimensional vector spaces with dimensions m and n. Let U V be the cartesian product of U and V . A function t : U V I ; (u; v ) t(u; v ) = t u u I is called a tensor R R and v . The tensors t form a vector space denoted by U V . The elements T V V are called if t is linear in u contravariant 2-tensors: T = T ij ci cj = T ij i j . The elements T V V are called covariant 2-tensors: i j i T = Tij = Tij dxi dxj . The elements T V V are called mixed 2 tensors: T = T .j cj = c c c i Ti.j dxi j , and analogous for T V V . The numbers given by t = t( , ) cc with 1 m and 1 n are the components of t. Take x U and y V . Than the function x y , de nied by (x y )(u, v ) =< x, u >U < y, v >V is a tensor. The components are derived from: (u v )ij = ui v j . The tensor product of 2 tensors is given by: 2 form: 0 0 form: 2 1 form: 1 7.5 q (v w)(p, ) = v i pi wk qk = T ik pi qk q (p )(v, w) = pi v i qk wk = Tik v i wk i q, (v p)( w) = v i qi pk wk = Tk qi wk Symmetric and antisymmetric tensors A tensor t V V is called symmetric resp. antisymmetric if x, y V holds: t(x, y ) = t(y, x ) resp. t(x, y ) = x ). t(y, A tensor t V V is called symmetric resp. antisymmetric if x, y V holds: t(x, y ) = t(y, x ) resp. t(x, y ) = t(y, x ). The linear transformations S and A in V W are de ned by: S t(x, y ) = At(x, y ) = 1 2 (t(x, y ) 1 2 (t(x, y ) + t(y, x )) t(y, x )) Analogous in V V . If t is symmetric resp. antisymmetric, than S t = t resp. At = t. 1 The tensors ei ej = ei ej = 2S (ei ej ), with 1 i j n are a basis in S (V V ) with dimension 2 n(n + 1). 1 The tensors ei ej = 2A(ei ej ), with 1 i j n are a basis in A(V V ) with dimension 2 n(n 1). The complete antisymmetric tensor is given by: ijk klm = il jm im jl . The permutation-operators epqr are de ned by: e123 = e231 = e312 = 1, e213 = e132 = e321 = 1, for all other combinations epqr = 0. There is a connection with the tensor: pqr = g 1/2 epqr and pqr = g 1/2 epqr . 7.6 Outer product Let k (V ) and l (V ). Than k+l (V ) is de ned by: = (k + l)! A( ) k !l! If and 1 (V ) = V holds: = Mathematics Formulary by ir. J.C.A. Wevers 46 The outer product can be written as: (a b)i = ijk aj bk , a b = G 1 (Ga Gb ). Take a, b, c, d I 4 . Than (dt dz )(a, b ) = a0 b4 b0 a4 is the oriented surface of the projection on the tz -plane R of the parallelogram spanned by a and b. Further a0 (dt dy dz )(a, b, c) = det a2 a4 b0 b2 b4 c0 c2 c4 is the oriented 3-dimensional volume of the projection on the tyz -plane of the parallelepiped spanned by a, b and c. (dt dx dy dz )(a, b, c, d) = det(a, b, c, d) is the 4-dimensional volume of the hyperparellelepiped spanned by a, b, c and d. 7.7 The Hodge star operator n k (V ) and n k (V ) have the same dimension because n = n k for 1 k n. Dim( n (V )) = 1. The choice k of a basis means the choice of an oriented measure of volume, a volume , in V . We can gauge so that for an 1 2 n e orthonormal basis ei holds: (ei ) = 1. This basis is than by de nition positive oriented if = ... = 1. ee Because both spaces have the same dimension one can ask if there exists a bijection between them. If V has no extra structure this is not the case. However, such an operation does exist if there is an inner product de ned on V and the corresponding volume . This is called the Hodge star operator and denoted by . The following holds: w k (V ) w k n (V ) k (V ) w = ( , w) For an orthonormal basis in I 3 holds: the volume: = dx dy dz , dx dy dz = 1, dx = dy dz , R dz = dx dy , dy = dx dz , (dx dy ) = dz , (dy dz ) = dx, (dx dz ) = dy . For a Minkowski basis in I 4 holds: = dt dx dy dz , G = dt dt dx dx dy dy dz dz , and R dt dx dy dz = 1 and 1 = dt dx dy dz . Further dt = dx dy dz and dx = dt dy dz . 7.8 Differential operations 7.8.1 The directional derivative The directional derivative in point a is given by: La f =< a, df >= ai f xi 7.8.2 The Lie-derivative The Lie-derivative is given by: (Lv w)j = wi i v j v i i wj 7.8.3 Christoffel symbols To each curvelinear coordinate system ui we add a system of n3 functions i of u, de ned by jk 2x x = i jk i uk u ui These are Christoffel symbols of the second kind. Christoffel symbols are no tensors. The Christoffel symbols of the second kind are given by: 2x i := i = , dxi jk jk uk uj Chapter 7: Tensor calculus 47 with i = i . Their transformation to a different coordinate system is given by: jk kj i j k = Ai Aj Ak i + Ai ( j Ai ) i i k jk k j The rst term in this expression is 0 if the primed coordinates are cartesian. There is a relation between Christoffel symbols and the metric: i = 1 g ir ( j gkr + k grj r gjk ) jk 2 and = (ln( |g |)). Lowering an index gives the Christoffel symbols of the rst kind: i = g il jkl . jk 7.8.4 The covariant derivative The covariant derivative j of a vector, covector and of rank-2 tensors is given by: i ja = j ai + i ak jk a = j ai k ak ij = a a + a = a a a a = a + a + a j ai a Ricci s theorem: g 7.9 = g =0 Differential operators The Gradient is given by: f xi xk grad(f ) = G 1 df = g ki The divergence is given by: div(ai ) = i ia 1 = k ( g ak ) g The curl is given by: rot(a) = G 1 d Ga = pqr q ap = q ap p aq The Laplacian is given by: (f ) = div grad(f ) = d df = ig ij j f = g ij i jf 1 = g xi g g ij f xj Mathematics Formulary by ir. J.C.A. Wevers 48 7.10 Differential geometry 7.10.1 Space curves We limit ourselves to I 3 with a xed orthonormal basis. A point is represented by the vector x = (x1 , x2 , x3 ). A R space curve is a collection of points represented by x = x(t). The arc length of a space curve is given by: t 2 dx d s(t) = + dy d 2 + dz d 2 d t0 The derivative of s with respect to t is the length of the vector dx/dt: ds dt 2 = dx dx , dt dt The osculation plane in a point P of a space curve is the limiting position of the plane through the tangent of the plane in point P and a point Q when Q approaches P along the space curve. The osculation plane is parallel with x(s). If x = 0 the osculation plane is given by: y = x + x + x so det(y x, x, x ) = 0 ... In a bending point holds, if x = 0: ... y = x + x + x The tangent has unit vector = x, the main normal unit vector n = x and the binormal b = x x. So the main normal lies in the osculation plane, the binormal is perpendicular to it. Let P be a point and Q be a nearby point of a space curve x(s). Let be the angle between the tangents in P and Q and let be the angle between the osculation planes (binormals) in P and Q. Then the curvature and the torsion in P are de ned by: d ds 2 = 2 = lim s 0 s 2 , 2 = d ds 2 and > 0. For plane curves is the ordinary curvature and = 0. The following holds: 2 = ( , ) = (x, x ) and 2 = (b, b) Frenet s equations express the derivatives as linear combinations of these vectors: = n , n = + b , b = n ... From this follows that det(x, x, x ) = 2 . Some curves and their properties are: Screw line Circle screw line Plane curves Circles Lines / =constant =constant, =constant =0 =constant, = 0 = =0 7.10.2 Surfaces in IR3 A surface in I 3 is the collection of end points of the vectors x = x(u, v ), so xh = xh (u ). On the surface are 2 R families of curves, one with u =constant and one with v =constant. The tangent plane in a point P at the surface has basis: c1 = 1 x and c2 = 2 x Chapter 7: Tensor calculus 49 7.10.3 The rst fundamental tensor Let P be a point of the surface x = x(u ). The following two curves through P , denoted by u = u (t), u = v ( ), have as tangent vectors in P du dx = x , dt dt dx dv = x d d The rst fundamental tensor of the surface in P is the inner product of these tangent vectors: dx dx , dt d = (c , c ) du dv dt d The covariant components w.r.t. the basis c = x are: g = (c , c ) For the angle between the parameter curves in P : u = t, v =constant and u =constant, v = holds: cos( ) = g12 g11 g22 For the arc length s of P along the curve u (t) holds: ds2 = g du du This expression is called the line element. 7.10.4 The second fundamental tensor The 4 derivatives of the tangent vectors x = c are each linear independent of the vectors c1 , c2 and N , with N perpendicular to c1 and c2 . This is written as: c = c + h N This leads to: = (c , c ) , h = (N , c ) = 1 det |g | det(c1 , c2 , c ) 7.10.5 Geodetic curvature A curve on the surface x(u ) is given by: u = u (s), than x = x(u (s)) with s the arc length of the curve. The length of x is the curvature of the curve in P . The projection of x on the surface is a vector with components p = u + u u of which the length is called the geodetic curvature of the curve in p. This remains the same if the surface is curved and the line element remains the same. The projection of x on N has length p = h u u and is called the normal curvature of the curve in P . The theorem of Meusnier states that different curves on the surface with the same tangent vector in P have the same normal curvature. A geodetic line of a surface is a curve on the surface for which in each point the main normal of the curve is the same as the normal on the surface. So for a geodetic line is in each point p = 0, so d2 u du du + =0 ds2 ds ds Mathematics Formulary by ir. J.C.A. Wevers 50 The covariant derivative /dt in P of a vector eld of a surface along a curve is the projection on the tangent plane in P of the normal derivative in P . For two vector elds v (t) and w(t) along the same curve of the surface follows Leibniz rule: d(v, w ) = dt v, w dt + w, v dt Along a curve holds: dt 7.11 dv du + v c dt dt (v c ) = Riemannian geometry The Riemann tensor R is de ned by: R T = T T This is a 1 tensor with n2 (n2 1)/12 independent components not identically equal to 0. This tensor is a measure 3 for the curvature of the considered space. If it is 0, the space is a at manifold. It has the following symmetry properties: R = R = R = R The following relation holds: [ , ]T = R T + R T The Riemann tensor depends on the Christoffel symbols through R = + In a space and coordinate system where the Christoffel symbols are 0 this becomes: 1 R = 2 g ( g g + g g ) The Bianchi identities are: R + R + R = 0. The Ricci tensor is obtained by contracting the Riemann tensor: R R , and is symmetric in its indices: 1 R = R . The Einstein tensor G is de ned by: G R 2 g . It has the property that G = 0. The Ricci-scalar is R = g R . Chapter 8 Numerical mathematics 8.1 Errors There will be an error in the solution if a problem has a number of parameters which are not exactly known. The dependency between errors in input data and errors in the solution can be expressed in the condition number c. If the problem is given by x = (a) the rst-order approximation for an error a in a is: a (a) a x = x (a) a The number c(a) = |a (a)|/| (a)|. c 8.2 1 if the problem is well-conditioned. Floating point representations The oating point representation depends on 4 natural numbers: 1. The basis of the number system , 2. The length of the mantissa t, 3. The length of the exponent q , 4. The sign s. Than the representation of machine numbers becomes: rd(x) = s m e where mantissa m is a number with t -based numbers and for which holds 1/ |m| < 1, and e is a number with q -based numbers for which holds |e| q 1. The number 0 is added to this set, for example with m = e = 0. The largest machine number is amax = (1 t ) q 1 and the smallest positive machine number is amin = q The distance between two successive machine numbers in the interval [ p 1 , p ] is p t . If x is a real number and the closest machine number is rd(x), than holds: rd(x) = x(1 + ) with | | 1 1 t 2 x = rd(x)(1 + ) with | | 1 1 t 2 The number := 1 1 t is called the machine-accuracy, and 2 , x rd(x) x An often used 32 bits oat format is: 1 bit for s, 8 for the exponent and 23 for de mantissa. The base here is 2. 51 Mathematics Formulary by ir. J.C.A. Wevers 52 8.3 Systems of equations We want to solve the matrix equation Ax = b for a non-singular A, which is equivalent to nding the inverse matrix A 1 . Inverting a n n matrix via Cramer s rule requires too much multiplications f (n) with n! f (n) (e 1)n!, so other methods are preferable. 8.3.1 Triangular matrices Consider the equation U x = c where U is a right-upper triangular, this is a matrix in which Uij = 0 for all j < i, and all Uii = 0. Than: xn = cn /Unn xn 1 = (cn 1 Un 1,n xn )/Un 1,n 1 . . . . . . n x1 = (c1 U1j xj )/U11 j =2 In code: for (k = n; k > 0; k--) { S = c[k]; for (j = k + 1; j < n; j++) { S -= U[k][j] * x[j]; } x[k] = S / U[k][k]; } 1 This algorithm requires 2 n(n + 1) oating point calculations. 8.3.2 Gauss elimination Consider a general set Ax = b. This can be reduced by Gauss elimination to a triangular form by multiplying the rst equation with Ai1 /A11 and than subtract it from all others; now the rst column contains all 0 s except A11 . Than the 2nd equation is subtracted in such a way from the others that all elements on the second row are 0 except A22 , etc. In code: for (k = 1; k <= n; k++) { for (j = k; j <= n; j++) U[k][j] = A[k][j]; c[k] = b[k]; for (i = k + 1; i <= n; i++) { L = A[i][k] / U[k][k]; for (j = k + 1; j <= n; j++) { A[i][j] -= L * U[k][j]; } b[i] -= L * c[k]; } } Chapter 8: Numerical mathematics 53 This algorithm requires 1 n(n2 1) oating point multiplications and divisions for operations on the coef cient 3 matrix and 1 n(n 1) multiplications for operations on the right-hand terms, whereafter the triangular set has to be 2 1 solved with 2 n(n + 1) operations. 8.3.3 Pivot strategy (1) Some equations have to be interchanged if the corner elements A11 , A22 , ... are not all = 0 to allow Gauss elimina(k 1) tion to work. In the following, A(n) is the element after the nth iteration. One method is: if Akk = 0, than search (k 1) for an element Apk with p > k that is = 0 and interchange the pth and the nth equation. This strategy fails only if the set is singular and has no solution at all. 8.4 Roots of functions 8.4.1 Successive substitution We want to solve the equation F (x) = 0, so we want to nd the root with F ( ) = 0. Many solutions are essentially the following: 1. Rewrite the equation in the form x = f (x) so that a solution of this equation is also a solution of F (x) = 0. Further, f (x) may not vary too much with respect to x near . 2. Assume an initial estimation x0 for and obtain the series xn with xn = f (xn 1 ), in the hope that lim xn = n . Example: choose f (x) = F (x) h(x) =x g (x) G(x) than we can expect that the row xn with x0 = xn = xn 1 h(xn 1 ) g (xn 1 ) converges to . 8.4.2 Local convergence Let be a solution of x = f (x) and let xn = f (xn 1 ) for a given x0 . Let f (x) be continuous in a neighbourhood of . Let f ( ) = A with |A| < 1. Than there exists a > 0 so that for each x0 with |x0 | holds: 1. lim nn = , n 2. If for a particular k holds: xk = , than for each n k holds that xn = . If xn = for all n than holds lim n xn =A , xn 1 lim n xn xn 1 =A , xn 1 xn 2 lim n xn A = xn xn 1 1 A The quantity A is called the asymptotic convergence factor, the quantity B = 10 log |A| is called the asymptotic convergence speed. Mathematics Formulary by ir. J.C.A. Wevers 54 8.4.3 Aitken extrapolation We de ne A = lim n xn xn 1 xn 1 xn 2 A converges to f (a). Than the row n = xn + An (xn xn 1 ) 1 An will converge to . 8.4.4 Newton iteration There are more ways to transform F (x) = 0 into x = f (x). One essential condition for them all is that in a neighbourhood of a root holds that |f (x)| < 1, and the smaller f (x), the faster the series converges. A general method to construct f (x) is: f (x) = x (x)F (x) with (x) = 0 in a neighbourhood of . If one chooses: (x) = 1 F (x) Than this becomes Newtons method. The iteration formula than becomes: xn = xn 1 F (xn 1 ) F (xn 1 ) Some remarks: This same result can also be derived with Taylor series. Local convergence is often dif cult to determine. If xn is far apart from the convergence can sometimes be very slow. The assumption F ( ) = 0 means that is a simple root. For F (x) = xk a the series becomes: xn = 1 k (k 1)xn 1 + a xk 1 n 1 This is a well-known way to compute roots. The following code nds the root of a function by means of Newton s method. The root lies within the interval [x1, x2]. The value is adapted until the accuracy is better than eps. The function funcd is a routine that returns both the function and its rst derivative in point x in the passed pointers. float SolveNewton(void (*funcd)(float, float*, float*), float x1, float x2, float eps) { int j, max_iter = 25; float df, dx, f, root; root = 0.5 * (x1 + x2); for (j = 1; j <= max_iter; j++) { (*funcd)(root, &f, &df); dx = f/df; Chapter 8: Numerical mathematics 55 root = -dx; if ( (x1 - root)*(root - x2) < 0.0 ) { perror("Jumped out of brackets in SolveNewton."); exit(1); } if ( fabs(dx) < eps ) return root; /* Convergence */ } perror("Maximum number of iterations exceeded in SolveNewton."); exit(1); return 0.0; } 8.4.5 The secant method This is, in contrast to the two methods discussed previously, a two-step method. If two approximations xn and xn 1 exist for a root, than one can nd the next approximation with xn+1 = xn F (xn ) xn xn 1 F (xn ) F (xn 1 ) If F (xn ) and F (xn 1 ) have a different sign one is interpolating, otherwise extrapolating. 8.5 Polynomial interpolation A base for polynomials of order n is given by Lagrange s interpolation polynomials: n Lj (x) = l=0 l=j x xl xj xl The following holds: 1. Each Lj (x) has order n, 2. Lj (xi ) = ij for i, j = 0, 1, ..., n, 3. Each polynomial p(x) can be written uniquely as n p(x) = cj Lj (x) with cj = p(xj ) j =0 This is not a suitable method to calculate the value of a ploynomial in a given point x = a. To do this, the Horner algorithm is more usable: the value s = k ck xk in x = a can be calculated as follows: float GetPolyValue(float c[], int n) { int i; float s = c[n]; for (i = n - 1; i >= 0; i--) { s = s * a + c[i]; } return s; } After it is nished s has value p(a). Mathematics Formulary by ir. J.C.A. Wevers 56 8.6 De nite integrals Almost all numerical methods are based on a formula of the type: b n f (x)dx = ci f (xi ) + R(f ) i=0 a with n, ci and xi independent of f (x) and R(f ) the error which has the form R(f ) = Cf (q) ( ) for all common methods. Here, (a, b) and q n + 1. Often the points xi are chosen equidistant. Some common formulas are: The trapezoid rule: n = 1, x0 = a, x1 = b, h = b a: b f (x)dx = h h3 [f (x0 ) + f (x1 )] f ( ) 2 12 a 1 Simpson s rule: n = 2, x0 = a, x1 = 1 (a + b), x2 = b, h = 2 (b a): 2 b h5 h [f (x0 ) + 4f (x1 ) + f (x2 )] f (4) ( ) 3 90 f (x)dx = a The midpoint rule: n = 0, x0 = 1 (a + b), h = b a: 2 b f (x)dx = hf (x0 ) + h3 f ( ) 24 a The interval will usually be split up and the integration formulas be applied to the partial intervals if f varies much within the interval. A Gaussian integration formula is obtained when one wants to get both the coef cients cj and the points xj in an integral formula so that the integral formula gives exact results for polynomials of an order as high as possible. Two examples are: 1. Gaussian formula with 2 points: h h 3 f (x)dx = h f h +f h 3 + h5 (4) f ( ) 135 2. Gaussian formula with 3 points: h f (x)dx = h 5f 9 h 3 5 + 8f (0) + 5f h 3 5 h 8.7 Derivatives There are several formulas for the numerical calculation of f (x): Forward differentiation: f (x) = f (x + h) f (x) 1 2 hf ( ) h + h7 f (6) ( ) 15750 Chapter 8: Numerical mathematics 57 Backward differentiation: f (x) = f (x) f (x h) 1 + 2 hf ( ) h Central differentiation: f (x + h) f (x h) h2 f ( ) 2h 6 The approximation is better if more function values are used: f (x) = f (x) = f (x + 2h) + 8f (x + h) 8f (x h) + f (x 2h) h4 (5) + f ( ) 12h 30 There are also formulas for higher derivatives: f (x) = 8.8 f (x + 2h) + 16f (x + h) 30f (x) + 16f (x h) f (x 2h) h4 (6) + f ( ) 12h2 90 Differential equations We start with the rst order DE y (x) = f (x, y ) for x > x0 and initial condition y (x0 ) = x0 . Suppose we nd approximations z1 , z2 , ..., zn for y (x1 ), y (x2 ),..., y (xn ). Than we can derive some formulas to obtain zn+1 as approximation for y (xn+1 ): Euler (single step, explicit): zn+1 = zn + hf (xn , zn ) + h2 y ( ) 2 Midpoint rule (two steps, explicit): zn+1 = zn 1 + 2hf (xn , zn ) + h3 y ( ) 3 Trapezoid rule (single step, implicit): 1 zn+1 = zn + 2 h(f (xn , zn ) + f (xn+1 , zn+1 )) h3 y ( ) 12 Runge-Kutta methods are an important class of single-step methods. They work so well because the solution y (x) can be written as: yn+1 = yn + hf ( n , y ( n )) with n (xn , xn+1 ) Because n is unknown some measurements are done on the increment function k = hf (x, y ) in well chosen points near the solution. Than one takes for zn+1 zn a weighted average of the measured values. One of the possible 3rd order Runge-Kutta methods is given by: k1 k2 k3 = = = = zn+1 hf (xn , zn ) 1 hf (xn + 1 h, zn + 2 k1 ) 2 3 3 hf (xn + 4 h, zn + 4 k2 ) zn + 1 (2k1 + 3k2 + 4k3 ) 9 and the classical 4th order method is: k1 k2 k3 k4 zn+1 = = = = = hf (xn , zn ) 1 hf (xn + 2 h, zn + 1 k1 ) 2 hf (xn + 1 h, zn + 1 k2 ) 2 2 hf (xn + h, zn + k3 ) zn + 1 (k1 + 2k2 + 2k3 + k4 ) 6 Often the accuracy is increased by adjusting the stepsize for each step with the estimated error. Step doubling is most often used for 4th order Runge-Kutta. Mathematics Formulary by ir. J.C.A. Wevers 58 8.9 The fast Fourier transform The Fourier transform of a function can be approximated when some discrete points are known. Suppose we have N successive samples hk = h(tk ) with tk = k , k = 0, 1, 2, ..., N 1. Than the discrete Fourier transform is given by: N 1 hk e2 ikn/N Hn = k=0 and the inverse Fourier transform by hk = 1 N N 1 Hn e 2 ikn/N n=0 2 This operation is order N . It can be faster, order N 2 log(N ), with the fast Fourier transform. The basic idea is that a Fourier transform of length N can be rewritten as the sum of two discrete Fourier transforms, each of length N/2. One is formed from the even-numbered points of the original N , the other from the odd-numbered points. This can be implemented as follows. The array data[1..2*nn] contains on the odd positions the real and on the even positions the imaginary parts of the input data: data[1] is the real part and data[2] the imaginary part of f0 , etc. The next routine replaces the values in data by their discrete Fourier transformed values if isign = 1, and by their inverse transformed values if isign = 1. nn must be a power of 2. #include <math.h> #define SWAP(a,b) tempr=(a);(a)=(b);(b)=tempr void FourierTransform(float data[], unsigned long nn, int isign) { unsigned long n, mmax, m, j, istep, i; double wtemp, wr, wpr, wpi, wi, theta; float tempr, tempi; n = nn << 1; j = 1; for (i = 1; i < n; i += 2) { if ( j > i ) { SWAP(data[j], data[i]); SWAP(data[j+1], data[i+1]); } m = n >> 1; while ( m >= 2 && j > m ) { j -= m; m >>= 1; } j += m; } mmax = 2; while ( n > mmax ) /* Outermost loop, is executed log2(nn) times */ { istep = mmax << 1; theta = isign * (6.28318530717959/mmax); wtemp = sin(0.5 * theta); wpr = -2.0 * wtemp * wtemp; wpi = sin(theta); Chapter 8: Numerical mathematics wr = 1.0; wi = 0.0; for (m = 1; m < mmax; m += 2) { for (i = m; i <= n; i += istep) /* { j = i + mmax; tempr = wr * data[j] - wi tempi = wr * data[j+1] + wi data[j] = data[i] - tempr; data[j+1] = data[i+1] - tempi; data[i] += tempr; data[i+1] += tempi; } wr = (wtemp = wr) * wpr - wi * wpi wi = wi * wpr + wtemp * wpi + wi; } mmax=istep; } } 59 Danielson-Lanczos equation */ * data[j+1]; * data[j]; + wr;

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

Formatting page ...

 

  Print intermediate debugging step

Show debugging info


 

 


© 2010 - 2026 ResPaper. Terms of ServiceContact Us Advertise with us

 

aman09064 chat