Challenges in Statistical Machine Learning
journal contributionposted on 01.01.2005, 00:00 by John D. Lafferty, Larry Wasserman
Machine learning and statistics are one and the same discipline, with different communities of researchers attacking essentially the same fundamental problems from different perspectives. In this note we brieﬂy describe some current challenges in the ﬁ eld of statistical machine learning that cut across the communities. We focus on areas where active development of learning techniques demonstrates promising performance, but where signiﬁcant gaps in the theoretical foundations remain; ﬁ lling the gaps will help to explain and improve upon this performance. The themes are high dimensional data, sparsity, semi-supervised learning, the relation between computation and risk, and structured prediction. Our selection of these themes is highly biased (and therefore has high risk), but we believe that these challenging areas can beneﬁt from a combination of the statistics and computer science perspectives on learning from data.