In One Test, AI Missed New Rules: A 10-Minute Check

You ask an AI a plain question about a visa or a new rule. The answer is calm, clear and wrong, because the rule changed this year and the AI did not know.

This page gives you four questions to ask, a template to fill in, and a 10-minute habit: open the official page yourself. We read the Vals AI test behind it on 9 November 2026. We have not run this method on a live account or a real case.

At a glance

• In one US immigration test, AI models did worst on rules from 2025 and 2026.
• Ask for the date, the country, the official page and what may have changed.
• Then read the official page yourself. The AI only points you to where to look.

This is for students, workers, small business owners and anyone who asks AI about rules. It is not for deciding a real case. For anything that matters, use the official page or a qualified adviser.

Imagined example, with a made-up form so nobody mistakes it for a real rule.

Priya is a student far from home. She asks an AI: "Do I need Form Z-9 to extend my stay?" The answer is confident. "No. Z-9 is only for people who arrived before 2023."

Priya relaxes and skips the form. Two weeks later she finds an official notice. Z-9 became compulsory for everyone on a date earlier this year. The AI was describing the old rule.

Nothing in the answer looked wrong. It had no date, no country and no link. That is the gap the method below closes. If you have ever skipped a form because a calm voice said you could, you know this feeling.

Vals AI is a company that tests AI models. With the Talent Mobility Fund, it published a test of US immigration questions on 28 October 2026. Experts wrote the questions and a grading checklist. Each checklist line is called a rubric item.

Here is the number that matters. Some rubric items cite a rule from 2025 or 2026. Without web search, models met 7.3% of those items. For all the other items, they met 64.0%.

Vals says that even with web search, the new-rule items were met only 29% of the time.

The authors advise users to "verify anything touching on recent policy against primary sources such as USCIS.gov". A primary source is the official body that makes the rule. That is the whole idea of this page.

Use these with any AI tool, on any rule that can change. It takes 2 minutes.

1. What is the effective date? The day the rule starts. If the AI says "not sure", that is useful.
2. Which country or region is this for? Rules differ. Say where you are, and ask where the rule applies.
3. Which official page publishes it? Ask for the name of the official body and the kind of page. Do not trust a link the AI types. Finding the current page is your job.
4. What may have changed since your knowledge date? Ask it to name what it could be missing from 2025 and 2026.

You should see each answer marked as known, guessed or not sure. If a point comes back sounding certain with no date, treat it as a guess.

AI tools can sometimes make up web addresses. Type the official site's name into a search engine yourself, or use an address you already know.

Paste this into an AI tool. Replace the words in capitals. Today's date matters, so type it.

I have a question about a rule that may have changed recently.
Do not answer as if you are sure.
QUESTION: [YOUR QUESTION]
COUNTRY OR REGION: [WHERE YOU ARE]
TODAY'S DATE: [TODAY]
Please give me, as a numbered list:
1) The rule in plain words, as you know it.
2) The year your knowledge of it comes from, or "not sure".
3) The effective date, or "not sure".
4) What may have changed in 2025 or 2026 that you could be missing.
5) The name of the official body and the kind of page that publishes the current rule. Do not invent a link.
6) Three words to search for on that official site.
Mark each point KNOWN, GUESS or NOT SURE.

Filled sample (imagined, with the made-up Form Z-9):

QUESTION: Do I need Form Z-9 to extend my stay?
COUNTRY OR REGION: Country X, the made-up place
TODAY'S DATE: 9 November 2026

What a careful AI might reply (imagined):

1) Z-9 was for people who arrived before 2023. GUESS
3) Effective date: NOT SURE
4) It may have become compulsory for everyone. GUESS
5) The immigration department's "forms" page. KNOWN
6) Z-9, extension, requirements

The filled sample tells Priya where to look and what to look for. It does not tell her the answer, and that is on purpose.

This is the step that makes the method work. Give it 10 minutes.

1. Find the official site. Search for the department's name, or type an address you already trust. Check the web address ends with the official domain, not a look-alike.
2. Search it with the three words from point 6.
3. Find the date on the page. Look for "last updated", "effective" or a date in the notice. Write it down.
4. Compare it with the AI's answer. Did the effective date or the rule differ?
5. Write one line: "Checked on [date] at [official page]: [what it says]."

For US immigration, Vals names USCIS.gov and the Federal Register as places to check. Other countries have their own official sites. If you cannot find a clear date, say so in your line. "No date found" is an honest result.

Afterwards, you can paste the official text and ask the AI to compare it with its first answer. Tell it to quote the page, not guess.

Try this today. Pick one rule you rely on that may have changed in the last two years. It could be a visa step, a tax deadline or a store return law. Run the date check. Then open the official page and write your one-line note with today's date.

If the official page and the AI agree, you now have a dated source. If they differ, you just caught the gap before it cost you.

• The AI gives an exact link. Do not click it. Say: "Do not give links. Tell me the name of the official body only."
• The AI sounds sure and gives no date. Paste: "Mark each point KNOWN, GUESS or NOT SURE, and give a date for each KNOWN."
• The official page has no date. Look for the notice, the news release or the change log. If you still find none, write "no date found" and ask the office or a qualified adviser.
• Two official pages disagree. Use the newer one with a date, and ask the office which applies to you.

• Vals tested AI models through their developer connections (APIs), not the chat apps most people use. Each model ran once per condition. We do not know whether the same numbers hold in the apps you use.
• The authors say an AI model graded the answers and another AI played the user. They also grouped "recent rules" automatically, by whether an item cites 2025 or 2026.
• The test covered 25 models and 65 new-rule items, all on US immigration. We use it as an example, not as proof for taxes or other laws.
• Search results were limited to pages published up to 21 September 2026, so later changes are not in the test.

This is not legal advice, and it does not replace a qualified adviser or the official office. For anything that can affect your status, money or rights, use them.

Do the date check on one rule today. Keep your one-line note somewhere you will find it, and look at it again in a month. Next time a post quotes a number, trace it with Trace a Statistic or Quote Back to Its Original Source.

Reviewed 9 November 2026. Figures were re-read on the pages below that day.

• Vals AI and Talent Mobility Fund: immigration benchmark post (28 October 2026)