Ranking is critical in any e-commerce platform. An optimal ranking should not only be user relevant but also target at maximizing the business KPIs. In order to achieve that, often a single optimal ranking algorithm might fall short in order to achieve the desired results. Usually optimal algorithm selection takes place with A/B testing framework, however using reinforcement learning techniques, can often achieve similar and even better results under certain circumstances. In this tutorial, we go through the basics of the standard methodologies for finding a better ranking strategy, and implement from scratch a reinforcement learning framework to find an optimal ranking method. In the process we compare and contrast the techniques and outline the scope of these methodologies.