Skip to main content

Understanding Assessments

Updated today

The Assessment is the core of every TSM. It's where you evaluate and grade different areas of your client's IT environment, from backup strategy and email security to endpoint management and server hosting. A well-run Assessment gives your client a clear picture of where they stand and what needs attention.

What the Assessment does

Each Assessment contains a list of items: topics you're evaluating for the client. Items are organized into groups (logical categories like Security, Infrastructure, Business Continuity, etc.). For each item, you grade how the client is doing, note the current status, identify risks, and recommend solutions.

The Assessment connects to the rest of your TSM in several ways:

  • Health Scores roll up from individual item grades to give an overall IT health picture

  • Roadmap and Budget pull items that have Budgets and timelines into your financial projections

  • Related technology data links actual Flexible Items to Assessment items, giving you real data to reference while grading

  • Arya AI uses the Assessment context and related data to generate recommendations

Working with Assessment item fields

Each Assessment item has several fields you fill out as part of your evaluation:

  • Grade: your rating for how the client is doing on this item. Grades drive the Health Score and determine whether the item shows as healthy or unhealthy.

  • Status: a description of where things stand today. Keep this factual and specific — "Running Exchange 2016 on-premises, end of support October 2025" is more useful than "Needs attention."

  • Risk: what could go wrong if this isn't addressed. This is what helps clients understand urgency — "Unsupported software increases vulnerability to security exploits and may violate cyber insurance requirements."

  • Solution: your recommendation for what to do. Be clear and actionable — "Migrate to Microsoft 365 Exchange Online. Estimated 2-week migration window, minimal user disruption."

  • Description: background context for the item. This is often pre-filled from the template and describes what this Assessment item covers.

  • Budget: estimated cost if there's work to be done. Items with budget data flow automatically into your Roadmap and Budget.

You don't need to fill in every field for every item right away. Start with grades and a few key items where you have strong recommendations, then build out more detail over time.

Editing items directly from a Report

You don't have to go back to template settings to adjust Assessment items. Open any draft Report in Build Mode and click the gear icon on an individual Assessment item to edit its settings — name, weight, tags, default values, and more. Changes made here update the template, so they apply across all Reports using that template.


This is a practical way to make small, iterative adjustments as you go. After running a few TSMs, you'll notice items that need a different weight, a better description, or a tag change. Editing from the Report lets you refine on the fly without interrupting your workflow.

Assessment grades and Health Scores

Grades are the ratings you assign to each Assessment item. Your template defines what grades are available and how they're used.

How grades work

Go to Settings > Templates > [Your Template] > Parts > Assessment > Grades to configure your grading system. Each grade has two important settings:

  • Include in Health: when checked, this grade is factored into the Health Score calculation. When unchecked, items with this grade are skipped entirely.

  • Healthy: when checked, items with this grade count as healthy (value = weight x 1). When unchecked, items count as unhealthy (value = 0).

How Health Scores are calculated

Health Scores use a weighted average. Each Assessment item has a weight (0-5) that you set at the template level.

The calculation works like this:

  • Items marked with a healthy grade are counted as: 1 x weight of the item

  • Items marked with an unhealthy grade (Include in Health is checked, but Healthy is not) are counted as: 0 x weight (the weight still affects the denominator)

  • Items with a grade where Include in Health is unchecked are skipped entirely, not included in the calculation at all

  • Items with no grade assigned are also skipped

Health Scores appear in several places: next to the company name in the companies list, next to Reports in the Reports list, for item groups within the Assessment tab, and in widgets (Last Report Health and Progress Chart) based on tag filters.

Tags

Tags are labels you can attach to Assessment items to organize and filter them. You can filter your Assessment view by tag, which makes it easy to focus on a specific subset of items without hiding or removing anything permanently.

Strategy Overview's standard Assessment template comes with a set of tags already built in. These are designed to help you scale your Assessment process progressively:

  • "1. Fundamentals": approximately 79 core items valuable for most MSPs to assess with any client

  • "2. Operating": approximately 65 items for more established vCIO processes

  • "3. Scaling": approximately 38 items for mature, advanced vCIO programs

Additional category tags (Efficiency, Security, Prospect, Vertical) help you filter items by topic area.

These are a starting point. You can create your own tags, rename existing ones, or build a tagging system that fits how your team works. Tags are managed at the template level under Settings > Templates > [Your Template] > Parts > Assessment > Tags.

Start with Fundamentals for your first several TSMs. Expand to Operating and Scaling as your process matures and as you learn what your clients need.

Hiding items and groups from client view

Not every Assessment item is relevant to every client. You have two ways to hide content from Display, Presentation, and Print modes while keeping it available in Build Mode:

Hide an entire group

Click the eye icon next to the group name in Build Mode. The icon changes to a crossed-out eye, and the entire group with all its items is hidden from client-facing views.

Important: If items in a hidden group have Budget values, those items will still appear in the Roadmap and Budget sections even though the group is hidden from the Assessment view.

Hide individual items using grades

Set up "hidden" grades, grades with Display Mode unchecked in your template's grade settings. When you assign a hidden grade to an item, it won't appear in Display or Presentation Mode.

To configure hidden grades: Settings > Templates > [Your Template] > Parts > Assessment > Grades. Uncheck "Display Mode" for any grade you want to use for hiding items.

Important: Like hidden groups, items with Budget values will still appear in Roadmap and Budget sections regardless of their grade visibility setting.

Related items: connecting technology data to Assessments

One of the most powerful features in Strategy Overview is relating Flexible Item groups to Assessment items. When you do this, the actual technology data appears right alongside the Assessment item, so when you're grading "Server Host," you can see the client's actual server list with age, warranty, and OS information.

This feature also enables Arya AI to give better recommendations because it has real client data to work with.

For setup instructions, see Tailoring Your Assessment in the Going Deeper collection.

Adding and managing Assessment items and groups

The standard template gives you a comprehensive set of items and groups to start with, but you're not limited to what's there. You can add your own items, create new groups, and customize the Assessment to match how your team works.

From the template (affects all clients)

To add items or groups that appear in every new Report:

Add a new item: In your template's Assessment settings (Settings > Templates > [Your Template] > Parts > Assessment), click Add Item within an existing group. Give it a name, set a default grade and weight, and configure any tags. This is useful when your team evaluates something specific that isn't in the standard template — like a vertical-specific compliance item or a tool your MSP standardizes on.

Add a new group: Click Add Group to create a new category. Groups let you organize items logically (Security, Infrastructure, Business Continuity, etc.) and they get their own Health Score rollup in your Reports.

From an individual Report (affects that client only)

You can also add items, groups, or duplicates directly from within a client's Report in Build Mode. This is useful when a specific client has a unique need that doesn't apply to your other clients.

Important: Items and groups added from within a Report only exist on that client's Report going forward. They are not added to your template and won't appear in other clients' Reports. If you want the change to apply everywhere, make it from the template settings instead.

Copying items and groups

You can duplicate existing items and groups when you need variations:

Copy a single item: Open the Assessment in Build Mode, click the ... menu on the item, and choose Duplicate. The system creates a copy right after the source item.

Copy a group: Hover over the group name, click the group's ... menu, and choose Duplicate group. A "Copy of..." group appears. Note that group duplication copies the group structure and settings but items within are copied as well with all their values.

Copies made from within a Report follow the same rule — they only exist on that client's Report. To add a copy to the template for all clients, duplicate from the template settings.

You need Edit permission (Admin, Manager, or Editor role) to add or copy items.

The Clear Item option

The Clear button on an Assessment item (available only in draft Reports) resets the item to its default state:

  • Grade resets to the item-specific default grade from the template, or the template's overall default grade

  • Status, Risk, Solution, Budget, and custom text fields clear to empty, or fill in with default values if defaults are configured

  • Location stays unchanged

  • All other fields clear their values

This is useful when you want to start fresh on an item without deleting and re-adding it.

Recurring costs in Assessments

If Assessment items have recurring expenses (like annual software licenses or monthly service costs), you can track them directly in the Assessment and have them flow into your Roadmap and Budget.

Enabling recurring costs

  1. Go to Settings > Templates > [Your Template]

  2. Go to Assessment > Columns

  3. Enable the Recurring ON toggle

Filling in recurring fields

For each item with recurring costs, you can set:

  • Recurring: the amount of the recurring expense

  • Period: monthly, quarterly, yearly, etc.

  • Qty: quantity (the system multiplies recurring cost by quantity)

  • Effective: start date for when the expense begins

  • Cancellation: when the expense ends

Date behavior: The effective date determines when recurring costs start appearing. If you set a cancellation date in the middle of a period, that period is excluded. If the cancellation falls on the last day of a period, that period is included.

Recurring costs from Assessment items flow automatically into your Flexible Roadmap and Flexible Budget parts.

Using Arya AI with Assessments

Arya can help you fill out Assessments faster by analyzing your connected data and suggesting grades, statuses, risks, and solutions. For the full guide on using Arya with Assessments, see Arya AI Assessment Assistant in the Arya AI collection.

Key points:

  • Select one or more Assessment items, then click Ask Arya

  • Arya works best when items have related Flexible Items connected, this gives it actual client data to analyze

  • Review all suggestions before applying. Arya provides a side-by-side comparison of current values vs. suggestions

  • You can calibrate Arya's behavior by editing column descriptions and grade legends in your template settings

Did this answer your question?