Decision problems are usually complex and involve evaluation of several conflicting criteria (parameters). Multi Criteria Decision Making (MCDM) is a promising field that considers the parallel influence of all criteria and aims at helping decision makers in expressing their preferences, over a set of predefined alternatives, on the basis of criteria (parameters) that are contradictory in nature. The Analytic Hierarchy Process (AHP) is a useful and widespread MCDM tool for solving such type of problems, as it allows the incorporation of conflicting objectives and decision makers preferences in the decision making. The AHP utilizes the concept of pair wise comparison to find the order of criteria (parameters) and alternatives. The comparison in a pairwise manner becomes quite tedious and complex for problems having eight alternatives or more, thereby, limiting the application of AHP. This paper presents a soft hierarchical process approach based on soft set decision making which eliminates the least promising candidate alternatives and selects the optimum(potential) ones that results in the significant reduction in the number of pairwise comparisons necessary for the selection of the best alternative using AHP, giving the approach a more realistic view. A supplier selection problem is used to illustrate the proposed approach.