Skip to main content

How to check an AI assistant's answer about your rent and your numbers

Ask the assistant to show where each number came from, then check two or three against the ledger or the bank. An answer from a connected tool reading your records is reliable on facts, but the assistant can still misread a question or guess when data is missing. A quick spot check takes a minute.

Two kinds of AI answers, and how much to trust each

KindExampleHow to treat it
Read from your records by a connected toolWho has not paid this month; the T12 for building A.Reliable on the data itself. Check that it understood the question and the date range.
Written from the assistant's own memoryWhat late fee is allowed in my state.Treat as a lead. Confirm with the statute. See can you trust ChatGPT on landlord-tenant law.

The risk with the first kind is not made up data. It is a question that was slightly different from the one you meant: this month versus last, one property versus all, paid versus posted.

A one minute checklist

  1. Ask for the scope. "Which properties and which dates does that cover?"
  2. Ask for the rows. "List the tenants behind that total." A total with no rows cannot be checked.
  3. Pick two or three rows and open them in the ledger or the bank. Do the amounts and dates match?
  4. Check that the total equals the sum of the rows. Ask for the math if it does not.
  5. For anything that moves money or sends a notice, read the draft and the approval yourself before you accept.

Example a made-up assistant says $18,240 of rent was collected in October across three buildings. You ask for the rows. They are 14 payments from building A, 9 from B and 6 from C. You open two tenants in the ledger, the amounts match, and the sum of the rows is $18,240. You move on in under a minute.

Red flags in an answer

  • A round number where cents should appear. Rent comes in exact amounts.
  • No mention of dates or properties.
  • Confident language about a rule or a deadline with no source. Ask for the citation, then open it.
  • A different answer to the same question asked twice. Ask which is right and why.
  • A tenant name or amount you do not recognize. It may be a mix-up with a similar name.

If something looks off, say so. Ask the assistant to show its source or to run the check again. Do not act on a number you cannot trace.

Money in code, not in the chat

The safest design keeps arithmetic out of the language model. Totals, balances and late fees should be computed by software against the ledger in exact cents and then handed to the assistant to explain. The assistant should describe numbers, not calculate them. If a tool leaves the math to the chat, double check every total.

Keep a record of what you relied on

If you act on an answer, such as sending a late notice or changing a rent, note which question you asked and which rows you checked. A short note in the tenant's file is enough. If the decision is ever questioned, you can show the numbers and where they came from.

How DoorKeeping handles it

In DoorKeeping, money math is done in code against the ledger in whole cents, and the tools return rows with the totals, so your assistant has something to show. Every action is written to an audit log with who did it. You can open the tenant ledger from Claude or ChatGPT, or on doorkeeping.com, and compare. Anything that moves money waits for your approval.

Sources

  1. DoorKeeping: Connect Claude or ChatGPT (steps and tools list), read Oct 30, 2026
  2. Model Context Protocol: Tools (specification), read Oct 30, 2026

Questions

Can I trust numbers from ChatGPT or Claude about my rentals?
Trust numbers read from your records by a connected tool more than numbers from memory. Either way, spot check two or three against the ledger or bank.
Why does an AI give a different answer when I ask again?
Language models can vary in how they read a question. Ask for the scope and the rows, and use the same wording each time.
How do I verify an AI answer about the law?
Ask for the statute section, then open it on the state's official site. Do not rely on a summary alone.
Should AI do the math on my rent roll?
Better that software computes the totals in exact cents and the assistant explains them.