In 1948 Shannon published the article that defines modern information theory. For this reading group, we will briefly remind the first part of the article about noiseless system, then we will present the second part of the article, which is concerned with transmission errors. We will in particular see how the trade-off between compression and robustness can be explained very simply with the notion of entropy introduced by Shannon.