Seminar by Teemu Roos (University of Helsinki) about Learning Context Trees via L1 Penalization in the Wavelet Domain.

Location: CWI portacabins, Kruislaan 413c, downstairs seminar room C001.

Abstract:

Teemu Roos: "We establish a connection between Lasso-type $\ell_1$ regularization and learning variable length Markov chains (VLMC).  This is achieved by a parameterization of discrete-valued finite-memory Markov sources in which setting a parameter value equal to zero is equivalent to eliminating a node in the corresponding context tree model.

The parameterization involves a Haar wavelet transformation on a set the indicator functions, the output of which is mapped to symbol probabilities via logistic regression. The optimization problem is convex and can be solved efficiently using existing tools. We present preliminary results, comparing the method to an earlier algorithm for learning VLMCs in terms of model selection and prediction performance. We also discuss other transformations which lead to a flexible family of sparse representations of Markov sources."