Mitochondria, like chloroplasts, tend to be inherited from just one parent. In the case of humans, it is the mother who contributes mitochondria to the zygote. Sperm do contain mitochondria, but they are not usually inherited. There have been cases but this is extremely rare.
