Choosing a fulfillment partner is choosing who touches your clients' most sensitive financial documents and who represents your brokerage on every file that goes through them. Most brokers evaluate this decision the way they'd evaluate any vendor — a sales call, a price sheet, a gut feeling — and only discover the gaps once files are already moving through the partner's process.
This scorecard is twenty questions across five blocks, each scored 1-5, designed to be run before a contract is signed rather than after the first rough file. It won't replace judgment, but it will surface the specific weak points — a privacy gap, an unclear escalation path, a pricing structure that hides its real cost — before they become someone else's problem, or worse, a client's.
How to run the evaluation
Score every question from 1 (major concern) to 5 (fully satisfies the standard), based on direct answers from the provider — not marketing language. If a provider can't answer a specific question clearly and specifically, score it low regardless of how confidently the rest of the conversation went.
Run this with at least two people from the brokerage side if possible, since different reviewers tend to catch different gaps — one may focus on process detail, another on the tone of the answers around privacy or escalation.
Before scoring anything: ask the provider for the same answers in writing after the call. A provider who hesitates to put verbal assurances in writing is telling you something about how reliable those assurances actually are.
Block 1 & 2. Canadian competence and privacy/data location
| # | Question |
|---|---|
| 1 | Does the team demonstrably understand Canadian regulator-specific terms — FSRA, BCFSA, RECA, AMF — and provincial licensing distinctions, rather than defaulting to US mortgage concepts? |
| 2 | Can they name and explain GDS/TDS and the OSFI stress test correctly without being prompted? |
| 3 | Do they understand the practical difference between insured, insurable, and conventional deals? |
| 4 | Have they actually worked with the specific lenders this brokerage uses regularly? |
| # | Question |
|---|---|
| 5 | Where is client data physically stored, and does that location create any cross-border transfer questions under Canadian privacy law? |
| 6 | What security measures protect data at rest and in transit, and how do those measures compare to an accepted safeguards standard for personal information? |
| 7 | What happens to client documents and data if the brokerage ends the relationship — is deletion or return contractually specified? |
| 8 | Who at the provider is accountable for a privacy incident, and what's the actual notification process and timeline? |
Question 6 is worth anchoring to an actual standard rather than a vague assurance — PIPEDA's Safeguards principle requires personal information to be protected by security measures appropriate to its sensitivity. Ask the provider to describe, specifically, what that looks like in practice for mortgage documents — not just that they “take privacy seriously.”
Block 3 & 4. Process & escalation, and pricing transparency
| # | Question |
|---|---|
| 9 | What's the documented process for a file from intake to funding, and can they walk through it specifically rather than in generalities? |
| 10 | What's the same-day acknowledgment standard for conditions and client documents? |
| 11 | Who is the named escalation contact when a file is stuck, and what's the response-time commitment? |
| 12 | How is work distributed and backed up if the specific person handling a file is unavailable? |
| # | Question |
|---|---|
| 13 | Is pricing a flat per-file rate, a percentage, or a hybrid — and is that structure explained in plain terms? |
| 14 | Are there additional charges for complex files (self-employed, multiple properties, rush timelines), and are they disclosed up front? |
| 15 | What happens, cost-wise, to a file that falls through before funding? |
| 16 | Is there a minimum volume commitment, and what's the cost of falling under it? |
Block 5. References & stability
| # | Question |
|---|---|
| 17 | Can they provide references from brokerages of a similar size and deal mix, not just their best-case client? |
| 18 | How long has the company operated in its current form, and has ownership or leadership changed recently? |
| 19 | What's their staff turnover like, and how is continuity maintained on a file if a team member leaves mid-process? |
| 20 | What happens to files in progress if the provider itself experiences a disruption — do they have a documented contingency plan? |
Scoring bands and what they mean
Add up all twenty scores for a total out of 100. The number matters less than where the weak points cluster — a provider that scores well everywhere except privacy is a different risk than one that's weak on pricing transparency alone.
- →85-100: Strong across the board — proceed to a trial with confidence, but still confirm the items scored below 4 individually.
- →65-84: Workable, with specific gaps — identify exactly which blocks are weak and address them directly in the contract before signing.
- →Below 65: Treat as a pass, or a return to the negotiating table on the specific weak blocks — a low total rarely improves once files are already moving.
The trial structure worth insisting on
Even a strong scorecard result doesn't replace seeing the provider work a real file. Insist on a trial period — a small, defined number of files, ideally a mix of straightforward and moderately complex — before committing to full volume.
Set explicit success criteria for the trial before it starts: acknowledgment speed, condition-clearing accuracy, communication quality with clients, and whether the file actually closed on time. Review the trial against those criteria specifically, not just a general impression of “it went fine.”
Renegotiation triggers worth watching for
A partnership that scored well at signing can drift over time — staff turnover, volume growth outpacing capacity, or a change in ownership can all quietly erode what made the original scorecard strong. Revisit the scorecard periodically, not just once.
- →A noticeable increase in condition-clearing delays or missed same-day acknowledgments compared to the trial period.
- →A change in the person or team handling files without a clear continuity plan.
- →Pricing changes introduced outside the original agreement's terms.
- →Any privacy or data-handling incident, however minor, that wasn't proactively disclosed.
For a deeper look at the build-vs-buy decision this scorecard sits inside, see Choosing a Mortgage Fulfillment Partner, and pair this scorecard with the File Handoff Playbook once a partner is selected, to make the actual transition clean.