... Sutton and Barto, 1998). We applied the algo-rithm of (Singh et al., 2002), as their experimentalset-up is similar to ours, constisting of: generationof (limited) exploratory dialogue data, using ... positions in the token stream of the utterance,also in combination with syntactic and semantic class labels. This allows us to define features that areparticularly useful for resolving confusing linguis-tic ... 2002; Peek and Chickering, 2005; Frampton and Lemon, 2006), for selecting initiative and con-firmation strategies (Singh et al., 2002); for detect-ing speech recognition problem (Litman and Pan,2002);...