The Hierarchical Softmax is useful for efficient classification as it has logarithmic time complexity in the number of output classes, log(N) for N output classes.
A short explanation of long short-term memory networks (LSTMs), a form of recurrent neural network (RNN) and a breakdown of Vinyals et al.