Why Use Prioritization Helper?

Businesses need a fair and organized way to make large decisions that affect multiple stakeholders, but many run into deadlocks since judgments and opinions vary.

But how is Prioritization Helper better than taking a vote? After all, wouldn’t it be faster and easier to send a poll to everyone? Truth is, people are imperfect beings. There are plenty of obstacles that get in the way of rational reasoning such as cognitive bias, sunk cost fallacy, or deciding with emotions and backing up with logic later.

While it’s possible to hold a vote for stakeholders, they might not make the most sound decision, or even pick the decision that truly holds all of their values. By relying on the Analytical Hierarchy Process (described below), it will do all of the calculations and work for you, ranking the most optimal choices for each individual. And the results may not always be what you’d expect if it was a simple poll where you input the answer.

There are a few situations that may need different types of decision making processes: winner-take-all or matrix scoring (coming soon).

For a winner-take-all situation, there are many options, but only one choice will be decided. Some use cases include hiring a candidate from a group interview, software selection, or deciding what restaurant will cater a company event. More use case suggestions here.  

We solve these issues with a pairwise comparison. This takes care of two types of opinions: importance of criteria (what Admin Ann finds important won’t always match Sales Sam or Finance Fran) and how well each option compares to the criteria.

To eliminate deadlocks, Prioritization Helper pairs criteria against each other for individuals to rate the importance of each. This way Finance Fran and Sales Sam are able to have their voices heard while contributing to the group decision.

Pairwise Comparison Definitions

Analytic Hierarchy Process (AHP) - Analytic hierarchy process is a decision making method created by Thomas L. Saaty to organize complex decisions. AHP helps teams and individuals find the best solution to their problem with “a comprehensive and rational framework for structuring a decision problem, for representing and quantifying its elements, for relating those elements to overall goals, and for evaluating alternative solutions.

“What-if?” Analysis - When running the final results, you will have the option to conduct a “what-if” analysis. Here, you can exclude certain criteria that may no longer be relevant, or was deemed least important by everyone. This will re-calculate the results excluding the unchecked criteria, and final results may change based on this new information.

Inconsistency Rating - This percentage will show people’s biases or mistakes. The higher the percentage, the more their results don’t line up with each other. You should aim to have your score under 10%, however you can move on to the next step no matter what score you get. This just gives you a chance to go back and fix any mistakes, or think about your choices longer.

Inconsistency Rating Screenshot

Pairwise Comparisons

Click on a section below to learn more

How to Create Pairwise Comparisons

We will use our own example to walk through creating a pairwise comparison.

  1. Decide on an objective - Our example will be choosing a theme to have at our Dreamforce ‘18 booth.
  2. Enter your alternatives - Alternatives are all of the possible options. Our options were between Rockstar or Toolbelt.Pairwise goal and alternatives
  3. Enter comparison criteria - These are the different ways you will evaluate the alternatives. Our list was:
    • Willingness of booth team to participate
    • Swag appeals to visitors
    • Fits with current branding
    • Interactive elements appeal to visitors
    • Theme feels exciting to visitors
    • Theme is memorable to visitors
    • Pairwise criteria
  4. Send it to all decision makers - We sent it to everyone in the company as all of the different departments (marketing, sales, leadership team, developers, etc.) would be affected by the decision.

Pairwise Invitation

Evaluating Pairwise Comparisons

Here are the steps all of the stakeholders and record owner will go through to submit their result. 
  1. Assign weights to criteria - Using the sliders, choose a number between 0-9 to indicate which of the two criteria are more important, with 0 being a tie and 9 indicating a criteria extremely more important than another.

    Weighing Criteria
  2. Weigh alternatives - This is the same process as weighing criteria, except this time you are judging each of the options against the criteria. The sliders will work the same way.

    Weighing Alternatives
  3. Individual results are calculated automatically - There will be a popup letting you know your results are sent. Afterwards, the owner and yourself may also view your individual results. All of the individual results will eventually be calculated together to decide an order of preferences, including their percentages.

Both when weighing criteria and the alternatives, there will be an inconsistency rating (for criteria it’s in the top left corner, for alternatives it’s at the top of each section). This percentage will show people’s biases or mistakes. The higher the percentage, the more their results don’t line up with each other. You should aim to have your score under 10%, however you can move on to the next step no matter what score you get. This just gives you a chance to go back and fix any mistakes, or think about your choices longer.

Inconsistency Rating

Button Menu

To see all of the button menu items, click the down arrow next to each pairwise comparison.

Pairwise Comparison Button Menu

View - You are able to check the objective, alternatives, and criteria for this comparison.

Result -  Aggregate everyone’s evaluations into a final result. Results can be saved as Salesforce files or exported as a PDF. In our case, Rockstar was the winner.

If you want to view individual results, you must click the number in the “participants” column.

Pairwise Comparison Results

You may also perform a “what-if” analysis on the results. Here you can exclude certain criteria that may no longer be relevant, or was deemed least important by everyone. This will re-calculate the results excluding the criteria unchecked, and final results may change based on this new information. In this example, if we only consider if the theme fits with current branding and the interactive elements appeals to visitors, the winner is Toolbelt.

Pairwise Comparison What-If Analysis

Evaluate - Cast your vote by weighing the criteria and alternatives.

Invite - Invite internal or external users to evaluate the pairwise comparison through email. Instructions on how to invite external users further down.

Clone - Create a duplicate of the pairwise comparison.

Access Restriction

This feature leverages Apex Managed Sharing, which is only available in certain Salesforce editions. Please reference the “Required Editions” section on this page for a list of supported editions.

Access Restriction allows granting or revoking access to individual pairwise comparisons. Users who do not have access are unable to see results or participate in the selected pairwise comparisons.

This effect can apply to any group of users (Setup -> Manage Users -> Public Groups) or individual users who does not have permissions that ignores sharing rules.

The following users will ignore the restrictions:

  • Any user with the system permissions “Modify All Data” and/or “View All Data.” For example, users with the System Administrator profile.
  • Any user with  the “Modify All” and/or “Read All” permission on individual pairwise comparison objects, such as users with the “Prioritization Helper - All Access” permission set.
    • Use the “Prioritization Helper - External” permission set for users who need to follow the restrictions.
  • Any users targeted by specific custom sharing rules that allow them to bypass the private sharing model on the Pairwise Comparison related objects (see here).


  1. On the “All Pairwise Comparisons” tab, select one or more pairwise comparisons.
  2. Click the “Access” button located in the table footer to open the “Configure Access” modal*.
    • If the “Access” button is not clickable, please check if:
      1. Your Salesforce edition is in one of the applicable editions listed in the link above
      2. Org Wide Default Sharing Rules are set to private on all related pairwise comparison objects (App’s default setup) via Setup -> Security Controls -> Sharing Settings)
  3. In the “Configure Access” modal, the left side lists the groups and/or users who have access to this pairwise comparison. Click on each name to go to the user’s record page. Click on the ‘X’ to the right of each tag to revoke access.
    • By default, new pairwise comparisons created will automatically grant access to the “All internal users” group. If external evaluation (Salesforce Site Setup) is enabled, Site Guest Users will have access as well.Groups and Users that Have Access
  4. In the “Configure Access” modal, the right side contains a search panel. Type a group or user’s name to begin searching, then select the desired entries and press “Add Selected.”
    • The record owner (whoever created the pairwise comparison) cannot be added, and will always have access to the pairwise comparison.Search for Users or Groups
  5. In the “Configure Access” modal, while entries are selected in the search results table, press the “Remove Selected” button to revoke access for the selected user and/or groups.
  6. Press “Save” to update the access.

*The “Access” button can also be found in the button menu drop down or on the invitation modal. If accessed from the invitation modal, the email addresses of the user and/or groups who you granted access will be added to the invitation modal automatically.

External Evaluation Setup

This guide is only applicable to the following environments due to the Salesforce Sites dependency: Developer, Enterprise and Unlimited Editions

Your edition information can be found under Setup -> Company Profile -> Company Information, on the “Organization Edition” field.

To setup the site to enable external evaluation (one-time setup):

  1. Click “Setup” on the top right corner (or the gear icon in Lightning Experience)
  2. Click on the quick search input box on the left panel, type ‘Sites’. The search result will update as you type.
  3. Click “Sites
    • If the “Sites” option does not show up in the search results, your environment may not have access to Sites, or your user may not have the “Customize Application” permission to configure sites. In the latter case, contact your environment's administrator and request for the “Customize Application” permission, or ask the administrator to perform the following steps.
  4. If prompted, register a site domain. Please note the prompted instructions on the page and beware that the site domain cannot be easily changed.
  5. Press the “New” button to create a new site, complete the form as follows (bolded lines must be entered exactly as specified):
    • Site label - PRTZ External Evaluation (or any name of choice)
    • Site name - prtz_groupeval
    • Site description - For Prioritization Helper’s external group evaluation (or any description of choice.)
    • Site contact - The user will be responsible for maintaining this site
    • Default web address - prtz (or any name of choice)
    • Active Site Homepage - PRTZ_Evaluator_VF
    • Active - Checked
    • All other options can be left as default.
  6. On the configuration page for the newly created site, press the “Public Access Settings” button. This will open the Site’s profile page.
  7. On the profile page, press the “Assigned Users” button. This will open a page with the Site user listed.
  8. On the Site user list page, click on the User entry to open the user record page.
  9. On the user record page, press the “Edit Assignments” button on the “Permission Set Assignments” section header
  10. Select the “Prioritization Helper - External” entry, add to the box on the right, and press “Save”

After the above steps are completed, to generate the link for external users:

  1. Open the “Prioritization Helper Home” tab
  2. Select any pairwise comparison
  3. Press the “Invite” button to open a modal
  4. On the modal, press the template icon button on the top of the modal to open the dropdown menu.
    • If the icon button does not exist, please double check the bolded items above
  5. On the dropdown menu, select “Overwrite with external links
  6. The link will be generated in the email body.

Matrix Scoring (Coming soon)