K-means clustering has been successfully used to extract features in a "deep learning" style architecture (with good results at image recognition). You'll probably find this useful: http://web.stanford.edu/~acoates/papers/coatesng_nntot2012.p...