Efforts to apply machine learning to HSI have produced mixed results as numerous challenges exist in applying these methods. This work describes these challenges along with on-going and future work aimed at reaping the potential benefits offered by machine learning in improving HSI data analysis.