Information Theory, Inference, and Learning Algorithms
MacKay
12 people recommended it in 11 threads, 2009–2024.
What people on Hacker News said
MacKay's "Information Theory, Inference, and Learning Algorithms" is a great read: http://www.inference.org.uk/itila/book.html
If you are interested in Bayesian probability, machine learning or information theory I recommend "Information Theory, Inference, and Learning Algorithms" by MacKay it's an amazing book.
Information theory, inference, and learning algorithms by MacKay (great book about probability, plus you can download the .tex source and read the funny comments of the author)
not about the subjects that you mention, but if you ever need to learn probability and inference, this is easily among the best books on the subject: http://www.inference.org.uk/mackay/itila/book.html
I'm not sure whether David Mackay's Information Theory, Inference, and Learning Algorithms (freely available at http://www.inference.org.uk/mackay/itila/book.html) counts as a textbook, but it's one of my favorite books, on any topic, in any genre.
He makes a pretty good case that his is the better textbook.
David MacKay's "Information theory, inference and learning algorithms" was a huge eye opener for me.
Where it comes up
- Reading list for those who love to learn 2009 · 2 recommendations
- Reading list to join AI field from Hugging Face cofounder 2024 · 1 recommendation
- Ask HN: Math books that made you significantly better at math? 2023 · 1 recommendation
- Ask HN: Which book can attract anyone towards your field of study? 2022 · 1 recommendation
- Ask HN: The book that did it for you in math and/or CS? 2022 · 1 recommendation
- In Praise of Open Source Textbooks 2021 · 1 recommendation
- Ask HN: What, in your opinion, are the greatest and most useful textbooks? 2020 · 1 recommendation
- Ask HN: Mathematicians, what textbooks are best for learning these math topics? 2019 · 1 recommendation
- Ask HN: What books changed the way you think about almost everything? 2019 · 1 recommendation
- Ask HN: What are your favorite statistics and probability textbooks? 2018 · 1 recommendation
- Ask HN: What books have you read in the first half of 2016? 2016 · 1 recommendation