Why did human brains decrease in size?

Our brains are three times as large as our closest evolutionary relative. But the size of the human brain hasn't just continually grown during our evolution.