This is the Accepted Manuscript version of an article that proposes HAR-Depth with sequential and shape learning along with the novel concept of depth history image (DHI) to address the challenges of Human action recognition (HAR). Results suggest that the proposed work of this paper performs better in terms of overall accuracy, kappa parameter and precision compared to the other state-of-the-art algorithms present in the earlier reported literature.