AI

EFFECTIVENESS

SCORECARD

AI Effectiveness Scorecard (Manager - Team - Regular)

Welcome!
Start
Velocity
Quality
Capability
Safety
Continuity
Mentality
Scalability
Reality

Thanks for taking the first step in understanding how your team is actually working with AI today.

This assessment looks at your team as a whole, not individual performance. The goal is to give you a clear snapshot of your team’s AI effectiveness as a unit, i.e. where things are working well, where friction exists, and where the biggest gaps may be holding results back.

This is not a performance review. There are no right or wrong answers, only signals. The insights are designed to support better decisions, not just better scores.

By the end, you’ll have a practical view of your team’s strengths and blind spots across the key drivers of effective AI use at work.

If you’d like to go deeper and assess individual team members’ AI effectiveness, email Noelle and we can help you set that up separately.

First Name

Company Name

Job Title

So, , over the last 4 weeks, when your team uses AI in their work, how often do their tasks seem to move from “started” to “ready to use” faster than you would normally expect?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

Based on what you see, which best describes the amount of "back-and-forth" needed before your team’s AI-assisted work is ready to use?

There is usually a lot of back-and-forth and it still takes a long time

There is some back-and-forth and it often needs further refinement

There are a few clarifications, but it becomes usable fairly quickly

There is minimal back-and-forth and their work is usually ready quickly

Their AI-assisted work is almost always ready to use with little or no delay

I can’t tell

Over the last 4 weeks, when AI is involved, how often does your team produce a first draft that is usable enough (just need slight refinement from your end), instead of needing major "rework"?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

When your team uses AI, how often does it help create momentum toward next steps (clear options, summaries, recommendations) rather than repeated drafts without closure?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

M01_sum

M01_weight

M01_score

M01_vis

Over the last 4 weeks, when your team members share work that appears to be AI-assisted, how often is it already clear and useful, requiring only minor edits from you?

Never – I usually have to rebuild or heavily rewrite it

Rarely – I often have to make major changes before it is usable

Sometimes – about half the time it needs substantial edits

Often – I mainly adjust nuance, details, or formatting

Almost always – it’s usually clear and ready to use with light tweaks

I can’t tell

Which of these best describes the typical feel of the team’s AI-assisted work, ?

Often generic, overlong, or off-brief – it “sounds AI” and adds work for others instead

Sometimes generic or shallow – I have to fix the logic or tighten it a lot

Mixed – some pieces feel generic, some are sharp and well-structured

Often sharp, well-structured, and easy to act on – I rarely fix the work

Consistently clear, well-structured, and context-aware – it adds real value

I can’t tell

When your team uses AI, how often is the output concise and structured, instead of overlong and hard to extract meaning from?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

When your team shares AI-assisted work, how often do you see signs that key points were checked (examples, reasoning, sources, or sensible assumptions), rather than taken at face value?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

M02_sum

M02_weight

M02_score

M02_vis

Think of a time before AI was available, and compare that to now. Do you notice your team members being able to handle different tasks due to AI?

No real change – they handle the same types of tasks as before

Slightly broader – they can handle a few extra tasks with support

Moderately broader – they can now handle several additional task types

Noticeably broader – they often take on work they could not do before

Much broader – they now handle a wide range of tasks beyond their original skill set

I can’t tell

When someone on the team is not unavailable, how well can another team member step into unfamiliar work and use AI to deliver a reasonable result?

They generally cannot take on unfamiliar tasks, even with AI

They can only help in a limited way and need a lot of guidance

They can cover some tasks, but results often need further work

They can cover key tasks and usually produce usable results

They can confidently cover a range of tasks and usually deliver strong results

I can’t tell

, when a team member uses AI to handle unfamiliar work, how often can they complete it with minimal handholding?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

Over the last 4 weeks, how often have you seen your team use AI to learn quickly and then apply that learning in real deliverables?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

M03_sum

M03_weight

M03_score

M03_vis

Over the last 4 weeks, based on what you see and hear, which best describes how your team uses AI with work information and tools?

They seem to paste whatever they need into any AI tool that suits them

They sometimes share internal or sensitive details in tools that may not be approved

They are somewhat cautious, but I am not always confident they check carefully

They appear generally careful with what they share and tend to use approved tools

They are clearly deliberate: they ask about data/tool risks, avoid sensitive details, and respect guidance or policies

I can’t tell

When this person shares work that AI has helped with, how clear is it to you and others that AI was involved, ?

It is usually not clear that AI was involved at all

It is occasionally mentioned, but not in a consistent way

It is mentioned sometimes, mostly on bigger or more important pieces

It is usually clear when AI has shaped the work

It is consistently clear – they are open about AI’s role and, where relevant, its limits or source quality

I can’t tell

Over the last 4 weeks, how often have you seen a team member avoid using AI (or switch to a safer option) because the task carried higher risk or sensitivity?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

When there is uncertainty about what can go into AI tools, how often does this person check or ask before proceeding?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

M04_sum

M04_weight

M04_score

M04_vis

Over the last 4 weeks, when AI tools were unavailable, slow, or restricted, how did your team typically respond?

Their work often stalled or stopped until the tools were available again

They experienced noticeable delays and needed close support to progress

They were sometimes able to adjust, but delays still showed up

They generally found ways to continue using other tools or approaches

They kept work moving smoothly, quickly finding alternatives with minimal disruption

I can’t tell

When AI tools, models, or usage rules change, which best describes how your team reacts?

They struggle significantly and their work slows down a lot

They need detailed guidance before they can move forward

They manage to adapt, but it causes visible friction for a while

They adapt with some support and then work returns to normal

They adapt quickly, experiment with options, and help others adjust as well

I can’t tell

, when AI tools change or fail, how quickly does your team return to normal delivery speed?

It often stalls them for days

It usually disrupts them for a full day

They usually recover within a few hours

They usually recover within 30 to 60 minutes

They recover quickly with minimal disruption

I can’t tell

How often do you see signs that your team’s AI use is tool-independent (they can switch without relying on one chat history or one tool’s interface)?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

M05_sum

M05_weight

M05_score

M05_vis

Over the last 4 weeks, thinking about your team’s day-to-day work, how often do you see signs that AI was part of their process (beyond simple spellcheck)?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

Based on the work you see and your conversations with your team members, how would you best describe how they typically use AI?

I see little to no evidence that they use AI

Mostly at the end, to improve wording or formatting

Sometimes after they have already done most of the work

Often near the start, to help plan, outline or structure the work

Regularly across multiple stages (planning, doing, refining)

I can’t tell

Based on what you see, across how many different types of work does a team member actively use AI in a typical week (not only writing or polishing), ?

0 to 1 type

2 types

3 types

4 types

5 or more types

I can’t tell

How often does your team show deliberate judgement in how they use AI, matching the approach to the task rather than applying AI in the same way each time?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

M06_sum

M06_weight

M06_score

M06_vis

Over the last 4 weeks, which statement below best describes how your team uses AI?

Their AI use seems personal – others do not see or reuse it

They occasionally mention tips, but nothing is easy for others to reuse

They share some prompts or ideas that a few people pick up

They create or suggest prompts, templates, or steps that multiple teammates reuse

They are a visible source of shared AI habits – their ways of working spread across teams or locations

I can’t tell

How much does your team members contribute to building shared AI habits or culture, ?

Not at all – they focus only on their own use of AI

A little – they share ideas informally, but it rarely becomes a habit for others

Somewhat – their suggestions occasionally shape how others work

Quite a lot – they help others adopt better AI practices in day-to-day work

Significantly – they are one of the people who actively shape and spread AI habits across teams or locations

I can’t tell

How often does your team members put prompts, templates, or workflows somewhere findable so others can reuse them later?

Never

Rarely

Sometimes

Often

Almost always

I can’t tell

If a new joiner joined tomorrow, how quickly could they pick up your team's AI work capabilities?

It's really up to the new joiner

It would take weeks

It would take several days

It would take a day

They could pick it up quickly with minimal help

I can’t tell

M07_sum

M07_weight

M07_score

M07_vis

Overall, how much has AI changed your team’s speed of producing useful outputs, ?

No change

Small change

Moderate change

Big change

Transformational change

I can’t tell

Lastly, how much has AI changed your team’s speed of producing useful outputs?

No change

Small change

Moderate change

Big change

Transformational change

I can’t tell

Execution_score

Trust_score

Leverage_score

Overall_score

Overall_vis