4 ms·

Matters Computational (2010) [pdf]

176 points by nill0 2y ago

sarosh 2y ago
This is the PDF of the following 2011 book focused on FFTs and fast arithmetic for both real numbers and finite fields. https://www.amazon.com/Matters-Computational-Ideas-Algorithms-Source/dp/3642147631?ref_=ast_author_mpb https://www.amazon.com/Matters-Computational-Ideas-Algorithm... The author is Jörg Arndt: born 1964 in Berlin, Germany. Study of theoretical physics at the University of Bayreuth, and the Technical University of Berlin, Diploma in 1995. PhD in Mathematics, supervised by Richard Brent, at the Australian National University, Canberra, in 2010.
- deleted 2y ago
  [deleted]
- Pinus 2y ago
  Given the title, I expected him to be a major general!
rramadass 2y ago
This book sits somewhere between "Hackers Delight" and "Numerical Recipes". The coverage is truly broad and detailed. It walks you through an implementation by the author called FXT (a library of algorithms) - https://www.jjj.de/fxt/ https://www.jjj.de/fxt/ and https://www.jjj.de/ https://www.jjj.de/ For some reason, the book is not well known and the author hates to advertise. But this is truly one of a kind book and deserves all the adulation from us (i own a print version).
- Alifatisk 2y ago
  I borrowed Hackers Delight from my local library, even though I didn’t fullt grasp every chapter I still found the book interesting and beautiful. Planning on buying it. I’ll check out Numerical Recipes and Matters Computational ideas etc.
  - tgv 2y ago
    Numerical Recipes is an old book, and received its share of criticism. It's also expensive, so beware before you buy. E.g. "`This chapter describes numerical methods for ODE's from the viewpoint of 1970."
  - sfpotter 2y ago
    I would give Numerical Recipes a pass.
    - leoc 2y ago
      Is there a single more modern and/or generally better alternative, as far as you know?
      - sfpotter 2y ago
        There isn't a single authoritative reference. It really depends on what you're doing. Numerical analysis and scientific computing are huge fields. If you have a specific area you're interested in, I can probably point you in the right direction. (Source: I did a PhD and postdoc in this field and research and develop numerical methods every day in industry. I have... a lot of books on this topic.)
      - rramadass 2y ago
        I disagree with the gp; Numerical Recipes should be the first one to consult simply because its breadth of coverage gives you a very good starting point. Then checkout other books based on your needs. However, here are some suggested alternatives - https://www.stat.uchicago.edu/~lekheng/courses/302/wnnr/nr-alt.html https://www.stat.uchicago.edu/~lekheng/courses/302/wnnr/nr-a...
        sfpotter 2y ago
        Another good approach can be to start by prototyping something in MATLAB, numpy/scipy, or Julia, and then consult their docs when whatever you're doing is falling short in some way. All of these computing environments have extensive references. Look up the function you're using in their docs and you'll find links to papers and books with more context. Being able to "help yourself" in numerical methods basically requires that you're comfortable in the literature. This assumes that you have a very sophisticated and precise need which is not satisfied by what existing libraries offer. If you have some quick one-off need, copying something from Numerical Recipes is a bad idea. Bugs in numerical methods can be very subtle and difficult to diagnose in a way that normal discrete algorithms aren't. If you've never heard of the asymptotic order of convergence of a numerical algorithm, how are you possibly going to detect that you have a bug there, let alone fix it? In my experience, most people who have one-off needs don't have the requisite background in numerical analysis to get themselves out of trouble when things go wrong. A better approach is to just use a library. There are lots of options for simple stuff. If you do have a sophisticated need, you will outgrow what Numerical Recipes offers very quickly. There are some good books in the list you linked, but that list is also very outdated. Notably absent: any of Trefethen's books (ATAP in particular), Nocedal and Wright's "Numerical Optimization", Stoer & Bulirsch, anything about convex optimization, anything about the finite element method, anything about geometry or CAD, anything about Monte Carlo, anything about special functions, and on and on...
- nyankosensei 2y ago
  I completely agree that this is a great resource. BTW, the Springer site book link is https://link.springer.com/book/10.1007/978-3-642-14764-7 https://link.springer.com/book/10.1007/978-3-642-14764-7. I’m thankful that the author has made the book and code freely available. The author also co-authored a book about historical and state-of-the-art pi computations called Pi Unleashed (https://link.springer.com/book/10.1007/978-3-642-56735-3 https://link.springer.com/book/10.1007/978-3-642-56735-3). The code and additional resources are available at https://extras.springer.com/?query=978-3-642-56735-3 https://extras.springer.com/?query=978-3-642-56735-3. Though somewhat dated (circa 2000), there’s a lot of fascinating information in the 229 Mb zip download, including a 133 char C program (pitiny.c) that computes 15000 digits of pi.
  - ZeroTalent 2y ago
    Glad you mentioned Pi Unleashed. That tiny pitiny.c program is legendary in its own right. It really highlights the minimalism—squeezing out every bit of performance and precision.
sidcool 2y ago
[flagged]
- djmips 2y ago
  But we will download it and put it in our special folder.
  - anonzzzies 2y ago
    ... next to my 40000 other papers / books / sites that I MUST read.
    - betimsl 2y ago
      Glad that I'm not the only one doing just that.
      - gessha 2y ago
        If only we spent less time collecting things on Hacker News and more time actually pursuing our interests…
        sidcool 2y ago
        May be collecting things on HN is the interest of people here.
        anonzzzies 2y ago
        I have reality -> that's the thing i'm working on, which happens to be a bunch of very hard problems which I need resolved as that's for a client. Then I have a dream -> that's the thing I want to do before I expire. And most theory is for the dreams, but the 'easier' project already needs a lot of research & effort.
  - MonkeyClub 2y ago
    >> This is so enticing to read, but alas, life is so short. Seneca has a brief treatise "On the brevity of life" that counters this exact feeling. In sum, it's not that life is too short (and the art too long), it's rather that we're not optimal in our use of life. It's worth a read - or a save in the special folder :)
shsj 2y ago
[flagged]
cytocync 2y ago
[dead]

176 points by nill0 2y ago

This is the PDF of the following 2011 book focused on FFTs and fast arithmetic for both real numbers and finite fields. https://www.amazon.com/Matters-Computational-Ideas-Algorithms-Source/dp/3642147631?ref_=ast_author_mpb https://www.amazon.com/Matters-Computational-Ideas-Algorithm... The author is Jörg Arndt: born 1964 in Berlin, Germany. Study of theoretical physics at the University of Bayreuth, and the Technical University of Berlin, Diploma in 1995. PhD in Mathematics, supervised by Richard Brent, at the Australian National University, Canberra, in 2010.

deleted 2y ago
[deleted]
Pinus 2y ago
Given the title, I expected him to be a major general!

rramadass 2y ago

This book sits somewhere between "Hackers Delight" and "Numerical Recipes". The coverage is truly broad and detailed. It walks you through an implementation by the author called FXT (a library of algorithms) - https://www.jjj.de/fxt/ https://www.jjj.de/fxt/ and https://www.jjj.de/ https://www.jjj.de/ For some reason, the book is not well known and the author hates to advertise. But this is truly one of a kind book and deserves all the adulation from us (i own a print version).

Alifatisk 2y ago
I borrowed Hackers Delight from my local library, even though I didn’t fullt grasp every chapter I still found the book interesting and beautiful. Planning on buying it. I’ll check out Numerical Recipes and Matters Computational ideas etc.
- tgv 2y ago
  Numerical Recipes is an old book, and received its share of criticism. It's also expensive, so beware before you buy. E.g. "`This chapter describes numerical methods for ODE's from the viewpoint of 1970."
- sfpotter 2y ago
  I would give Numerical Recipes a pass.
  - leoc 2y ago
    Is there a single more modern and/or generally better alternative, as far as you know?
    - sfpotter 2y ago
      There isn't a single authoritative reference. It really depends on what you're doing. Numerical analysis and scientific computing are huge fields. If you have a specific area you're interested in, I can probably point you in the right direction. (Source: I did a PhD and postdoc in this field and research and develop numerical methods every day in industry. I have... a lot of books on this topic.)
    - rramadass 2y ago
      I disagree with the gp; Numerical Recipes should be the first one to consult simply because its breadth of coverage gives you a very good starting point. Then checkout other books based on your needs. However, here are some suggested alternatives - https://www.stat.uchicago.edu/~lekheng/courses/302/wnnr/nr-alt.html https://www.stat.uchicago.edu/~lekheng/courses/302/wnnr/nr-a...
      - sfpotter 2y ago
        Another good approach can be to start by prototyping something in MATLAB, numpy/scipy, or Julia, and then consult their docs when whatever you're doing is falling short in some way. All of these computing environments have extensive references. Look up the function you're using in their docs and you'll find links to papers and books with more context. Being able to "help yourself" in numerical methods basically requires that you're comfortable in the literature. This assumes that you have a very sophisticated and precise need which is not satisfied by what existing libraries offer. If you have some quick one-off need, copying something from Numerical Recipes is a bad idea. Bugs in numerical methods can be very subtle and difficult to diagnose in a way that normal discrete algorithms aren't. If you've never heard of the asymptotic order of convergence of a numerical algorithm, how are you possibly going to detect that you have a bug there, let alone fix it? In my experience, most people who have one-off needs don't have the requisite background in numerical analysis to get themselves out of trouble when things go wrong. A better approach is to just use a library. There are lots of options for simple stuff. If you do have a sophisticated need, you will outgrow what Numerical Recipes offers very quickly. There are some good books in the list you linked, but that list is also very outdated. Notably absent: any of Trefethen's books (ATAP in particular), Nocedal and Wright's "Numerical Optimization", Stoer & Bulirsch, anything about convex optimization, anything about the finite element method, anything about geometry or CAD, anything about Monte Carlo, anything about special functions, and on and on...
nyankosensei 2y ago
I completely agree that this is a great resource. BTW, the Springer site book link is https://link.springer.com/book/10.1007/978-3-642-14764-7 https://link.springer.com/book/10.1007/978-3-642-14764-7. I’m thankful that the author has made the book and code freely available. The author also co-authored a book about historical and state-of-the-art pi computations called Pi Unleashed (https://link.springer.com/book/10.1007/978-3-642-56735-3 https://link.springer.com/book/10.1007/978-3-642-56735-3). The code and additional resources are available at https://extras.springer.com/?query=978-3-642-56735-3 https://extras.springer.com/?query=978-3-642-56735-3. Though somewhat dated (circa 2000), there’s a lot of fascinating information in the 229 Mb zip download, including a 133 char C program (pitiny.c) that computes 15000 digits of pi.
- ZeroTalent 2y ago
  Glad you mentioned Pi Unleashed. That tiny pitiny.c program is legendary in its own right. It really highlights the minimalism—squeezing out every bit of performance and precision.

sidcool 2y ago

[flagged]

djmips 2y ago
But we will download it and put it in our special folder.
- anonzzzies 2y ago
  ... next to my 40000 other papers / books / sites that I MUST read.
  - betimsl 2y ago
    Glad that I'm not the only one doing just that.
    - gessha 2y ago
      If only we spent less time collecting things on Hacker News and more time actually pursuing our interests…
      - sidcool 2y ago
        May be collecting things on HN is the interest of people here.
      - anonzzzies 2y ago
        I have reality -> that's the thing i'm working on, which happens to be a bunch of very hard problems which I need resolved as that's for a client. Then I have a dream -> that's the thing I want to do before I expire. And most theory is for the dreams, but the 'easier' project already needs a lot of research & effort.
- MonkeyClub 2y ago
  >> This is so enticing to read, but alas, life is so short. Seneca has a brief treatise "On the brevity of life" that counters this exact feeling. In sum, it's not that life is too short (and the art too long), it's rather that we're not optimal in our use of life. It's worth a read - or a save in the special folder :)

shsj 2y ago

[flagged]

cytocync 2y ago

[dead]