The topic you mention is an extremely broad one, so it is hard to find a general history of the subject (at least, I do not know of any book that covers all possible subtopics). Interesting material can be found on the website
http://history.siam.org/
of the Society for Industrial and Applied Mathematics (SIAM).