Math 4401: Numerical Methods

Page Status: Archived May 15, 2008. Course currently not being taught by Barry.
Last Update: Thursday, May 15, 2008
Page Author & Instructor: Barry McQuarrie


Session: Spring 2008        Instructor: Barry McQuarrie        Office Hours:
TTh 10:00-11:40am Office: Science 1380 10:00--11:30am MWF
Location: Sci 3665 Phone: 589-6302 (I do not use voicemail)
mcquarrb@morris.umn.edu drop in (if my door is open we can talk, if it is closed I am not available)
http://cda.morris.umn.edu/~mcquarrb/ other times via email appointment


Course Prerequisites

To succeed in this course you will need to have mastered basic calculus (Calculus I and Calculus II), differential equations, and certain topics in linear algebra (notably Gaussian elimination and eigensystems). You should have a good background in Mathematica.

Goals

Upon completion of this course a student should be able to:

Textbook

Numerical Analysis 8th Ed. by Richard L. Burden & J. Douglas Faires.

There is a webpage for the text: http://www.as.ysu.edu/~faires/Numerical-Analysis/. There is a list of typos that made their way into the first printing of the eighth edition, so you should visit the errata part of the site and make the corrections to your text if necessary.

We will be covering Chapters 1, 2, 3, 4, 8, 5, 6, 7,and 9 (in that order) from the text, with some sections omitted. I will also be provided some notes for Padé approximants and Monte Carlo Integration, which are not covered in the text.

Programming Expectations

The website for the textbook contains programs for all the algorithms in the text in C, fortran, maple, Mathematica, MATLAB, and Pascal. This makes the textbook very useful to you once the course is completed. If you do any programming in the future this text will provide you with an excellent place to start.

You will have to do a certain amount of simple programming in the course, mainly using looping structures like Do or While. These capabilities exist in Mathematica, and I will help you with coding in Mathematica. Your peers in the course are also an excellent resource if you have a question about the course.

If you prefer to use other coding languages such a fortran or java, go right ahead-however, I will not be able to help you with these languages as much.

Mathematica

Mathematica has many useful features to someone interested in numerical analysis. Many of Mathematica's internal routines use numerical methods, but of course in this class we are more interested in how the method works than simply implementing it. Mathematica can be used to help you with the arithmetic manipulations you need to do, but your solutions should also contain legible, hand written discussions about what it is you are doing.

I have quite a few Mathematica notebooks on my web page from the various courses I have taught over the years. These may serve as a useful guide. On my web page I will be placing Mathematica notebooks for you to download and experiment with, especially any notebooks I use during lectures. As well, there is an abundance of Mathematica assistance available on the web, and you should use those resources as you see fit. My web page has links to some relevant sites, and the UMM math department web page has links as well.

As the focus of this course is understanding numerical methods rather than simply implementing them, you should use Mathematica essentially as a simple CAS to help you do arithmetic, take derivatives or integrals where necessary, and plot graphs. You will also need to do simple programming with Mathematica.

For example, if I ask you to find a root of x5 - cos x = 0 using Newton's method, I would not accept as an answer

FindRoot[x^5 - Cos[x] == 0, {x, 1}]
but I would accept
f[x_] = x^5 - Cos[x]
xnew[0] = 1.0
xnew[n_] := xnew[n] = xnew[n - 1] - f[xnew[n - 1]]/f'[xnew[n - 1]]
TableForm[Table[{n, xnew[n]}, {n, 0, 10}]]

If you have any questions about what my expectations are at any time during the course, make sure you ask me.

Course Components

Assignments. There will be a selection of homework questions assigned throughout the semester. Since an important aspect of the course is the communication of ideas, you should concentrate on first solving the problem, and then communicating the solution in a manner understandable to others. You may work together on assignments, but each student turns in their own assignment, and any group work should involve proper collaboration and not simply copying of another student`s work.

Midterm Exam and Final Exam. These exams will have questions similar to the assignment questions and be a take home exam. You will not be allowed to work in groups or discuss the test with your peers.

The exams will be handed out during class, and handed in to me in my office (Sci 1380). While you are working on a take home exam there will be no lectures scheduled. The final exam will be due at the end of the scheduled exam time for the course, which is 3:30pm May 15.

Analysis Project. The analysis project is an important part of the course, since it will require you to investigate a numerical method on your own (no group work on this project). Acquiring this skill is one of the main goals of the course. The project should be based on one of the methods from the text which we did not study in class, or some other numerical technique that is not in the textbook but that you find interesting.

The project will consist of two components, a paper (60 marks) and oral presentation (40 marks). The Applied Project will be graded out of 100 marks.

Your Paper

Your paper should be about 10 pages long, and written with proper sectioning, numbered equations, and include an abstract and bibliography. It should be typed, using Word, LaTeX, or Mathematica (or other typesetting software like OpenOffice). If you have lots of complicated equations or figures to typeset, you can write those in neatly by hand. Your paper will be graded based on neatness, organization, grammar, and mathematical content. Your paper should include the following:

  1. The Method
    • describe in words and general pictures what the method does
    • describe (derived if possible) in math
  2. An Application of the Method
    • worked through by hand (entirely, or one step of the solution)
    • a more complex problem solved using a computer (include computer code)
  3. Conclusion
    • strengths, weaknesses of method
    • when it should be used
    • possible improvements
  4. References
There is a short Word document that serves as a style guide for writing a mathematical paper a http://cda.morris.umn.edu/~mcquarrb/mathstyle.dot.

I keep the reports you submit as part of the Math discipline's assessment efforts, so if you want a copy for yourself make one before you hand your paper in. I will provide a feedback sheet explaining your grade for the paper.

Your Presentation

The presentations will be 30 minutes long, so you will probably have to edit what is in your paper and determine what is the best way to get your main points across. You may use overheads, the whiteboard, powerpoint, LaTeX, Mathematica, or webpages in your presentation. Remember, the presentation is about communicating information, not about flashy effects. Some of the best presentations I have seen used simple, neatly written overheads. Keep the following in mind as you prepare your presentation:

Grading

Here is the University-wide uniform grading policy.

A few of you may be taking the course S-N. In this case, you need to earn a C- to receive an S. An incomplete grade (I) is only given under truly extraordinary circumstances (falling behind in the course is not a sufficient reason for an I to be granted).

You will be graded on assignments, an analysis project, a midterm exam and a final exam. The course marks will be split in the following fashion:

Assignments (4 at 15% each) 60%
Final Exam 15%
Midterm Exam 15%
Analysis Project 10%

Your numerical grades will be converted to letter grades and finally Grade Points via the following cutoffs (see the UMM Catalog for more on Grades and Grading Policy). If you are taking the course S-N, you will need to earn a C- or better to obtain an S grade.

Numerical 95% 90% 87% 83% 80% 77% 73% 70% 65% 60% Below 60%
Letter A A- B+ B B- C+ C C- D+ D F
Grade Point 4.00 3.67 3.33 3.00 2.67 2.33 2.00 1.67 1.33 1.00 0.00

Please note that you are not competing against your fellow students. I will adjust the difficulty of the questions and the severity of the grading so that, for example, a B+ score corresponds to what I consider B+ achievement.

Expectations


Course Calendar

Here is the tentative lecture schedule. Check here for Mathematica notebooks which are used in class, other handouts, etc. If the lecture is listed as being in Sci 1380, that means we won't be having a lecture, but I will be in my office if you need to talk to me. Note that the second lecture is in Sci 2530!

Lecture Schedule Spring 2008
# Date Notices Topic Reading Resources
 
1 Jan 22 Course Introduction 1.1, 1.2, 1.3 Mathematica | Proof of Taylor`s Theorem
2 Jan 24 Sci 2530 Mathematica Lab   Mathematica | Mathematica Quick Reference
 
3 Jan 29 Rootfinding 2.1, 2.2 Mathematica
4 Jan 31 Newton Methods 2.3, 2.4 Mathematica | Roots of Unity | article
 
5

Feb 5

Accelerating Convergence 2.5, 2.6 Mathematica | article
6 Feb 7 Padé Approximants 8.4 & Handout Mathematica | application | algebraic approximants
 
7 Feb 12 Assgn #1 Due Lagrangian Interpolation 3.1, 3.2 Mathematica
8 Feb 14 Hermite Interpolation 3.3 Mathematica
 
9 Feb 19 Cubic Splines 3.4 Mathematica | application
10 Feb 21 Numerical Differentiation 4.1, 4.2 Mathematica
 
11 Feb 26 Assgn #2 Due Composite Quadrature 4.3, 4.4 Mathematica
12 Feb 28 Romberg Integration 4.5, 4.6 Mathematica
 
13 Mar 4 Gaussian Quadrature 4.7 Mathematica | Maxwell Velocity Distribution
Orthogonal Polynomials
14 Mar 6 Monte Carlo Integration Handout Mathematica | Quasi Random Sequences
Monte Carlo Methods in Chemistry | Sobol Sequences
 
15 Mar 11 Least Squares 8.1, 8.2 Mathematica | Gram-Schmidt Orthonormalization
16 Mar 13 Assgn #3 Due Chebyshev Approximation
Take Home Midterm handed out.
DUE: Mar 27 in Sci 1380 by 11:40am
8.3 Mathematica
 
Mar 18 Spring Break
Mar 20 Spring Break
 
17 Mar 25 Sci 1380 Work on Take Home Midterm
18 Mar 27 Sci 1380 Work on Take Home Midterm
 
19 Apr 1 Topic chosen for Analysis Project. Initial Value Problems 5.1, 5.2, 5.3 Mathematica
20 Apr 3 Runge-Kutta 5.4, 5.5 Mathematica
Derivation of Runge Kutta Methods | article
 
21 Apr 8 Predictor-Corrector 5.6, 5.7 Mathematica | application
22 Apr 10 Dynamical Systems 5.9, Handout Mathematica | application | Pursuit Problems
 
23 Apr 15 Gaussian Elimination
Linear Systems; Matrix Inversion, Determinants, Matrix Factorization
6.1, 6.2, 6.3, 6.4, 6.5 Mathematica
24 Apr 17 Assgn #4 Due Norms 7.1, 7.2 Mathematica | article (logarithmic matrix norms)
 
25 Apr 22 Iterative Matrix Methods 7.3, 7.4 Mathematica | sparse matrix collection
26 Apr 24 Eigenvalues 9.1, 9.2, 9.3, 9.4 Mathematica | article
 
27 Apr 29 CANCELED Newton's Method for Systems
Take Home Final handed out.
DUE: May 15 in Sci 1380 by 3:30pm
10.2 Mathematica
28 May 1 Analysis Project Presentations:
10:00-10:30 Person 1
10:35-11:05 Person 2
11:10-11:40 Person 3
 
29 May 6 Analysis Project Paper Due Analysis Project Presentations:
10:00-10:30 Person 4
10:35-11:05 Person 5
11:10-11:40 Person 6
30 May 8 Sci 1380 Work on Take Home Final