INTEGRATED MODEL FOR SUPPLIER SELECTION AND PERFORMANCE EVALUATION

This paper puts forward a model for selecting suppliers and evaluating the performance of those already working with a company. A simulation was conducted in a food industry. This sector has high significance in the economy of Brazil. The model enables the phases of selecting and evaluating suppliers to be integrated. This is important so that a company can have partnerships with suppliers who are able to meet their needs. Additionally, a group method is used to enable managers who will be affected by this decision to take part in the selection stage. Finally, the classes resulting from the performance evaluation are shown to support the contractor in choosing the most appropriate relationship with its suppliers.


INTRODUCTION
The competitiveness of an organisation is increasingly associated with its ability to establish and maintain a cooperative relationship with its suppliers.Besides, according to Bevilacqua et al. [1], an organisation needs to have the capacity to choose adequate suppliers.As a result, companies seek lasting relationships in order to establish partnerships with a smaller number of vendors with greater quality and credibility.According to Zeydan et al. [2], at the same time as lowering costs, firms work continually with suppliers to reduce product design periods, improve quality, reduce lead time, and generate greater innovation through better design and increased flexibility.Moreover, suppliers can have either a very positive or a very adverse impact on the overall performance of an organisation [3].So finding good partners is a vital issue for the management of a company.
The analysis of suppliers aims to assess their impact on the pricing, quality, risk, and delivery capabilities of any firm [4,5], has a direct financial and operational impact on the business [6], and adds value to end-customers [7].Consequently, decisions about suppliers are fundamental to successful supply chain management [8].For these reasons, how best to develop relationships with suppliers has been a topic of considerable research effort in supply chain management [9].
Amin and Razmi [10] assert that most research studies have focused on selecting or evaluating suppliers separately.However, it is essential to use integrated methodologies to select the suppliers who will be contracted, and to evaluate the performance of those that already work with a company.Thus, because several factors relate to this analysis, it can be characterised as a multicriteria decision aid problem [2,11,12], and it is therefore necessary to determine the relative importance of the criteria [13].
This study thus puts forward a multicriteria decision aid model to assist companies to select suppliers, to evaluate the performance of those that work with them, and, based on this evaluation, to provide information about the type of client-supplier relationship that must be established between the parties.Thereafter, a simulation of the model that was conducted in a Brazilian company in the food industry, which has great importance for the economy of country, is described.
The food industry was chosen for many reasons.First, food supply chains are an important subset of the broader supply chain environment due to their importance to global and local populations, economic prosperity, and the vulnerablity of food supply chains [14].Second, food has a direct effect on customers' health, which prompts the need for products to have high levels of quality.Moreover, according to Ni-Di and Ming-Xian [15], the emphasis on the quality of resources, on delivery time, and on costs adds a high level of complexity when outsourcing and making decisions on selecting suppliers.The Brazilian Association of Food Industries [16] has stated that there are thirty-two thousand formal enterprises in the sector, the turnover of which was equivalent to 9 per cent of Brazil's gross national product in 2011; and it has noted the importance of selection and performance evaluation in this industry.
This paper is organised as follows.Section 2 reviews the literature on multicriteria methods used to select and evalute suppliers.Section 3 describes the model proposed, and Section 4 illustrates it by way of a numerical simulation.Section 5 presents the conclusions of this research.

MULTICRITERIA METHODS FOR SUPPLIER SELECTION AND PERFORMANCE EVALUATION
With increasing competition, companies need to find ways of managing their business that result in the continuous improvement of their performance with customers.There has been increasing recognition of the need for a firm to work closely with its supply chain partners in order to optimise its business activities [17].
In this context, the ability to create close relationships with their fundamental suppliers is essential to improve the overall performance of the supply chain, and to help firms to achieve lower product costs, to reduce time-to-market, to improve quality, to introduce advanced technology, or to improve service delivery.One important issue for this type of relationship is how best to select suppliers who will adequately meet the needs of the firm, and how to evaluate their performance in order to choose those with whom the firm should create long-term relationships.
Supplier selection and performance evaluation are considered to be multicriteria problems.The nature of these problems is both widely diverse and complex because of the type of solutions to be investigated and the methodological approaches that can be used to address them [18].Because of this, according to Ho et al. [19], several approaches to multicriteria decision aid have been proposed to select and evaluate suppliers.
Nevertheless, supplier selection is considered to be a group decision problem [11,25,26] because it is essential to take account of the preference of several decision-makers (DMs) whose activities will be affected by the choice of suppliers.Therefore, some group decision methods are used when selecting suppliers [5,11,26].
For supplier evaluation, Chen et al. [11] used fuzzy PROMETHEE for a group decision problem to evaluate four potential suppliers to a bank, in order to improve the decision process of outsourcing.Dagdeviren and Eraslan [27] used PROMETHEE in their studies too.Lin [12] proposed an integer method for supplier evaluation and optimal allocation of orders, using ANP and FPP (fuzzy preference programming) to measure the weights of selected suppliers, and MOLP (multi-objective linear programming) to allocate the quantities of optimal orders to each supplier.
The integration of the processes of selecting suppliers and evaluating their performance is very important to an efficient relationship with suppliers.However, in the literature review, few papers with this integration were found: Wang [5] presented a 2-tuple-based evaluation method to measure the performance level of suppliers.As a result, their performance was classified as 'perfect', 'promising', 'moderate', or 'bad'; and, in line with this classification, it was recommended what kind of relationship firms should have with these suppliers.Schramm, F. and Morais [28] proposed a model based on SMARTER (simple multi-attribute rating technique extended to ranking) to select suppliers in the building industry, and evaluated the suppliers that the model selected.
The major contribution of this paper is to construct an integrated multicriteria model for the phases of both selecting suppliers and evaluating their performance.In the selection phase, the model enables the firm to choose between using a single DM and group decisionmaking, and takes restrictions on resources into account.Finally, the classification of suppliers in the evaluation phase is essential to support firms and to note what type of relationship they should build with the contracted suppliers.This can help a firm to improve its overall performance and, consequently, its competitiveness.

Identification of the organisation's objectives
The first phase of the decision process consists of identifying the organisation's goals in relation to its suppliers (Figure 1).Determining these objectives is essential so that suitable partners that are able to meet its business needs will be chosen.

Figure 1: Steps for identifying the organisation's goals
The first step is to identify the actors who, directly or indirectly, are affected by the process.If the preferences of individuals are convergent, the group can choose one person to be the DM who will use a simple decision method; but if there is divergence over their preferences, the use of group decision procedures is necessary.Therefore, a committee of DMs who are familiar with the company's internal and external needs should be created.
The phase of determining the pre-selection and selection criteria then takes place.Subsequently, the company obtains an overview of its objectives.
In this context, the criteria used were those identified by Viana and Alencar [29] in a survey carried out with food companies listed in the ABIA (Brazilian Association of Food Industries).
It was determined that the pre-selection criteria would be those mentioned by more than 50 per cent of the respondents when asked what criteria should be used in the preselection of suppliers.The selection criteria would be those mentioned by more than 40 per cent of the respondents when asked what criteria to use when selecting long-term suppliers.The criteria presented in both classes were allocated to the category in which they had obtained the highest percentage of citations.

Supplier selection
The proposed model is shown in Figure 2. The methodology is used to select and evaluate the performance of suppliers of strategic products, since these items attract the largest costs and risks when modifying suppliers.This phase sets out to select a subset of suppliers who meet the company's needs, based on the steps presented in Sections 3.2.1,3.2.2, and 3.2.3below.

Identification of strategic products and potential suppliers
The committee should identify the strategic products for the selection process and the potential suppliers of these products, who are then regarded as the alternatives to be considered in the decision model.The model will be used separately to identify the suppliers of each item to be purchased.

Pre-selection
Suppliers will be screened and evaluated in the multicriteria decision aid model.The committee should analyse which candidates meet the levels stipulated as acceptable in the pre-selection criteria.Only the suppliers with higher-than-satisfactory levels continue with the process.

Determination and application of the group decision method
The need to choose a method that considers qualitative and quantitative criteria, and that has non-compensatory logic aggregation, was noted.This is because companies normally want to select alternatives that perform acceptably in all the criteria.Thus the use of outranking methods is satisfactory in this situation.Additionally, supplier selection is In this stage, an adaptation of the PROMETHEE group method [30] is used, in which PROMETHEE II is replaced by PROMETHEE III in both individual and global evaluations.This choice occurs because PROMETHEE III considers actions that have net flows which are both very close as being indifferent, while PROMETHEE II would prefer one supplier over another, even if both presented very similar performances.Thus, in the context of supplier selection, PROMETHEE III is more appropriate.The PROMETHEE group adaptation is shown in Figure 3.An integer programming method is used in the final selection stage.The method applied is the adaptation of PROMETHEE V proposed by Almeida and Vetschera [31].It was used to select a subset of suppliers who meet the company's needs, in line with the constraints imposed.
According to Brans and Mareschal [32], this method has two steps: the outranking net flow is computed from PROMETHEE II; and the integer programme problem is constructed in order to consider the additional restrictions.In the PROMETHEE V adaptation [31], the optimal portfolio is determined by solving the following mixed integer optimisation problem: where: Φ i is the net flow of alternative Ai, x i is a dummy (when xi=0, the action does not stay in the portfolio; and when xi=1, the action stays in the portfolio), r i is the number of resource units required by Ai,

Ranking of suppliers
R is the number of resource units available, and c is the number of items in the portfolio.
In this case, the authors initially proposed optimising portfolios of the same size, and defined a c-optimal portfolio as the best portfolio containing c items.Thereafter the coptimal portfolios were ranked, using their resulting value to select the best one.Thus all the alternatives that could improve the performance of the portfolio would be inserted in line with the restrictions imposed.

Supplier evaluation
This phase sets out to evaluate the suppliers contracted by the firm, and assigns them to predetermined classes that help the DM to decide on the type of relationship to construct with each.In this stage, the evaluation will be carried out by one individual who knows and takes into account the preferences of the members of the committee, and who will define the evaluation criteria.Supplier evaluation occurs in the steps:

Identification of evaluation criteria
The DM should determine which criteria are important for evaluating the performance of the suppliers with whom the company wishes to create a long term relationship after they have been contracted.
The criteria used for the food industry in this phase were collected by Viana and Alencar [29].In this context, the criteria determined were those cited by more than 40 per cent of respondents when asked which criteria they consider when evaluating a supplier's performance.The criteria are: delivery (EC 1 ), quality of product/service (EC 2 ), compliance with company procedures (EC 3 ), efficiency (EC 4 ), technical capabilities (EC 5 ), commitment (EC 6 ), credibility (EC 7 ), flexibility (EC 8 ), and history of performance (EC 9 ).

Determination and application of a multicriteria decision method
As to the choice of an acceptable method, it is important to note that the evaluation criteria can be quantitative or qualitative.In supplier evaluation, non-compensatory methods must be used because good performance in one criterion should not compensate for bad performance in another.Finally, the objective of this model is to assign the alternatives to predefined ordered classes.Therefore a multicriteria sorting method called PROMSORT (PROMETHEE Sorting) is used in this model.This method is suitable for this problem due to the following features, set out by Araz et al. [33]: it uses both 'limit profile' and 'reference alternative' concepts; offers the DM the flexibility to define an optimistic or pessimistic point of view; and guarantees the ordered categories.

Classification of suppliers
As a result of this method, the suppliers are classified into the three classes proposed by Aksoy and Öztürk [34]: • Class A: Suppliers have good results from the evaluation of their performance, and the manufacturers continue to work with them and to establish a long-term relationship.

•
Class B: They meet the needs of the company in some respects, but have several defects in their system and need to improve them.The firm needs to inform suppliers about these problems and about ways to solve them.

•
Class C: They have poor results from the evaluation of their performance, and manufacturers stop working with them if they continue in this class for two consecutive reviews.
Performance evaluation must be done periodically to maintain the performance levels that companies desire.Therefore, after contracting other suppliers, the limit profiles should be redefined.

APPLICATION OF THE PROPOSED MODEL
This section presents a simulation of the proposed model in order to illustrate its use.
Simulation is an interactive process, which has the advantage of revealing important information and new perceptions in relation to a problem.This enables improvements to be made to the model before it is applied in real situations.
For this application, a typical problem of supplier selection and evaluation was created.Suppose that a food company needs to select and evaluate suppliers of chocolate chip cookies -its main product.The industry wants to select suppliers with a balanced performance in all the criteria, and the power of each DM in the process is to be included.A logistics manager, who had worked for several years in a food industry, helped to measure weights and choose the preference functions and parameters used in the model for the numerical application.

Determining the firm's objectives and choosing the selection committee
Various departments of the company with conflicting interests were involved in the supplier selection.A three-member committee was therefore simulated (Table 1), representing the sectors that influence the process.

Table 1: Members of selection committee
The committee then determined the pre-selection and selection criteria (section 3.1).

Identification of the strategic products and of potential suppliers
The committee identified the strategic items for chocolate chip cookies: invert sugar (P 1 ), cocoa powder (P 2 ), chemical leavening agents (P 3 ), and sodium acid pyrophosphate (P 4 ).Since the multicriteria model for supplier selection can deal with only one product at a time, the simulation demonstrates the choice of the first item.
Next, ten potential suppliers were identified: S 1 , S 2 , S 3 , S 4 , S 5 , S 6 , S 7 , S 8 , S 9, and S 10 .These are the alternatives to be considered in the decision model.

Pre-selection
Once the qualifying criteria had been identified, a pre-selection of suppliers was made in relation to their performance against these criteria (Table 2).

Table 2: Qualifier criteria
From the committee's evaluation of the suppliers' performance against the qualifying criteria, Table 3 was compiled.
According to Table 3, alternatives S 4, S 6, S 7, and S 10 performed below the qualifying level in some criteria, and were removed from the process.Production capacity and facilities 60% PC 5 Compliance with company procedures 90%

Final selection
After defining which alternatives would remain in the selection process, each DM constructed an evaluation matrix (alternatives versus criteria), in which the alternatives for the model were generated.Thereafter, each DM determined the preference functions, which, according to Brans and Vincke [35], reflect a DM's preference between two alternatives, and are defined separately for each criterion.Brans and Vincke [35] proposed six functions for PROMETHEE (Table 4).

•
The indifference threshold (q) is the largest value of d for which the DM considers that the alternatives are indifferent;

•
The preference threshold (p) is the lowest value of d for which the DM considers that there is a preference for one alternative over another.

•
σ is a parameter connected with the standard deviation of the normal distribution.
The data for DM1 were determined by a manager who works in the food industry; that for DM2 was identified based on Viana and Alencar [29]; and that for DM3 in accordance with research knowledge.The weights of the criteria, as well as the preference functions and the parameters for each criterion, are shown in Table 5.
PROMETHEE III was then used to provide a decreasing ranking of alternatives.The interval flows were calculated for each alternative, using α= 0.15.Since no intersections occur between intervals of alternatives with successive ordering, there is no indifference between the suppliers identified.
To create a global ranking of suppliers, a global evaluation matrix was compiled, comprising the alternatives cited, while the DMs represented the criteria.For this simulation, the members of the group have equal decision-making power, so the weight of each DM is 1/3.The preference function is the usual criterion.The final order of the alternatives is given in Table 6.To select multiple suppliers, the global flows obtained in PROMETHEE II were used as an input to the adaptation of PROMETHEE V proposed by Almeida and Vetschera [31].This identifies the best portfolio of suppliers from among the existing alternatives, in line with the constraints on resources.
The input data to the problem is the price offered by the suppliers for 1,000 kg of invert sugar and the net flows of each alternative (Table 7).The imposed restriction was the available cash flow for the contract, and that the company could only buy 1,000 kg from each supplier.

Table 7: Input data for PROMETHEE V
Initially, the solution of classical PROMETHEE V was calculated, using the scale transformation proposed by Mavrotas et al. [37].Then there was a change of scale, in accordance with the method of Macharis et al. [30].In the first case, the p-optimal portfolio included S 1 , S 3 , S 8, and S 9 .In the second situation, the result was a portfolio comprising S 1 , S 2 , S 3 , S 5, and S 9 .Subsequently, the values of optimal portfolios for each criterion were calculated.In this phase, the values of alternatives for each criterion were determined by a member of committee that synthesize the preferences of DMs.Thereafter, the averages were summed and the portfolio values for all criteria found.The concordance indices were compared to choose the best one.It was noted that the coptimal portfolio was better than the classical portfolio in 47 per cent of weights and the same in 10 per cent; so the former should be chosen.The supplier portfolio would thus comprise S 1 , S 2 , S 3 , S 5, and S 9 .Although S 2 , S 3, and S 5 had negative flows, this did not mean that they had negative values, but rather that they were outranked by others.So these alternatives were incorporated into the portfolio to improve its global performance.To verify the robustness of the model, a sensibility analysis was conducted from the variation in the weights of criteria for each DM.A variation of ±15 per cent in the weights of credibility and quality was allowed.When these weights were decreased, the results did not change.When they were increased in PROMETHEE III, the indifference between S 1 and S 9 was noted.The other alternatives remained in the same order.The result of PROMETHEE V was not modified.According to this analysis, the model was considered robust.

Supplier evaluation
In the performance evaluation, all the suppliers who are contracted to provide strategic products are analysed at the same time, because the objective of this phase is to discover the type of relationship that the firm should create with its suppliers, and because the result for one supplier does not influence the relationship of the firm with the others.Additionally, there is only one DM because the creation of a committee to make continuous evaluations would involve a very high cost.
Initially, the criteria that are important for the relationship between suppliers and clients were determined, as set out in the proposed model.Next, the alternatives of the model were identified.Suppose that the suppliers of all strategic products of the firm were considered.There were four suppliers of P 1 (S 1 P 1 , S 2 P 1 , S 3 P 1 , S 4 P 1 ), one for P 2 (S 1 P 2 ), three for P 3 (S 1 P 3 , S 2 P 3 , S 3 P 3 ) and two for P 4 (S 1 P 4 , S 2 P 4 ).
For the application of PROMSORT, an evaluation matrix was created (Table 8), considering the values of the criteria for the alternatives and limit profiles.

Table 8: Evaluation matrix
Then the DM determined the weights, preference functions, and parameters of the criteria, in accordance with his preferences (Table 9).

Table 9: Weights, preference functions, and parameters of the criteria for PROMSORT
Thereafter the alternatives were compared with the limit profiles according to the outranking relation of PROMETHEE I, and the suppliers were sorted into the classes A, B and C accordingly.The resulting arrangement of the alternatives is shown in Table 10.
According to the results, the company should establish long-term relationships with S 3 P 1 and S 1 P 2 .Alternative S 1 P 1 is incomparable with L 1 .In this case, the classification of this  It is very important that the company gives feedback about the performance evaluation to its suppliers, as a way for them to improve against the criteria for which their performance is bad, and to try to become a Class A supplier.In the case of Class C suppliers, the company should explain why it has stopped working with them.
Finally, to verify the robustness of the proposed model, a sensitivity analysis was conducted from the variation in criteria weights.A variation of ± 15 per cent in the weights of quality and flexibility was allowed.It was observed that the result was still the same in the two situations.Consequently, the proposed model is robust for small modifications in the weights of criteria.

CONCLUSION
This paper puts forward a multicriteria decision aid model to select suppliers and evaluate the performance of those already contracted.For this a methodological model was proposed.Although this systematic is based on the PROMETHEE family, the methods are normally used separately for a specific objective.The novelty of this approach is to combine different methods -group PROMETHEE III, PROMETEE V, and PROMSORTconsidering the features of each method for each problematic addressed, to achieve the objective of the study.Moreover, the authors developed an adaptation of group PROMETHEE to help the DMs determine preference or indifference limits between the alternatives that seem appropriate to the supplier selection context.
The main advantage of this proposal over other methods is that it integrates the phases of selecting and evaluating the performance of suppliers by using methods appropriate to the context.It is noted that there is a need for integrated models to cover these two stages, since unstructured selection processes may result in contracting suppliers who do not neet the company's needs.Also, even if the organisation has a structured selection process, when the firm does not evaluate supplier performance during the term of the contract, the performance can decrease over time, thereby adversely affecting the client.So the processes should be conducted in an integrated manner.
Other advantages of the proposed model are:

•
In the selection phase the model uses a group decision multicriteria method to involve individuals from various departments of the organisation that are directly affected by the choice of suppliers; • In the performance evaluation phase, it assigns contractors to pre-defined classes and determines what type of relationship the organisation should build with the suppliers of each of these classes.
After the systematisation process, the use of multicriteria methods was proposed.To select suppliers, an adaptation of group PROMETHEE was recommended.Thereafter, an adaptation of PROMETHEE V was used to select an appropriate subset of suppliers.Finally, in the performance evaluation, PROMSORT was used to assign suppliers to predetermined classes.Thus, some observations can be made about the model: • The use of PROMETHEE methods leads to a model that is closer to reality, incorporates the qualitative and quantitative aspects of the process, is flexible, and is easy to understand;

•
The group PROMETHEE allows weights to be assigned to DMs, reflecting their level of power in making the decision;

•
The interval order of PROMETHEE III allows alternatives with insignificant differences in the net flow to occupy the same position;

•
The use of the adapted method of PROMETHEE V when selecting multiple suppliers enables the maximum use of available resources; • In the performance evaluation phase, the model meets the need to group suppliers according to their relationships with partners.

•
The use of non-compensatory methods avoids choosing alternatives with a very high performance in one criterion and a very low one in another.
Finally, there was a numerical application of the model in the food sector.The criteria used were identified from the work of Viana and Alencar [29] in the food industries indexed in ABIA.The weights, functions, and other parameters were determined by a logistics manager from the food industry and the authors of this paper.Although the application was carried out in the food industry, the proposed model can be used in other kinds of organisations to improve the management of strategic suppliers and acquire long-term relationships with those that adequately meet the firm's needs.
Future research may consider the use of the model in other sectors of industry, the use of other procedures for assigning criteria weights, and the use of other multicriteria methods when applying the proposed model.

Figure 2 :
Figure 2: Proposed model out by a group of DMs.In this case, it is assumed that they have conflicting specific objectives, making it necessary to use a group multicriteria decision aid model.

Table 10 -
Classes of alternativesalternative was made using a pessimistic vision, and S 1 P 1 was assigned to Class B. The suppliers S 1 P 1 , S 2 P 1 , S 4 P 1 , S 1 P 3 , S 3 P 3 , S 1 P 4, and S 2 P 4 were good, but needed to improve in some aspects.Finally, S 2 P 3 was a bad supplier, and the company needed to stop working with this supplier.