Deep Thinking, But Not Too Deep