Skip to main content
Paid tests use your saved environments, requests and agent/model choices. Each combination runs eight times on every plan. You need permission to manage the project to request or cancel a test.

Estimate

  1. Open Agent Picks › Overview, Matrix or Settings › Agent Picks.
  2. Select Request a test.
  3. Review the run count and the Expected and High credit estimates.
  4. Select Confirm and reserve credits to queue the test.
Expected is the estimated spend. High is the amount reserved from your account’s shared credit balance before the test starts. Changing environments, requests or models changes the estimate. If the setup or estimate changed after you reviewed it, request a fresh estimate and confirm again. Only one paid test can be queued or running per project, including re-tests. Requesting another while one is active does not reserve more credits.

Settlement and refunds

Completed runs charge their recorded usage. Failed runs and runs cancelled before starting charge no credits. A run cancelled after starting charges its recorded spend. When a completed run or a run cancelled after starting has unknown spend, it charges the greater of its recorded spend and its share of the reservation. The share is the high reservation divided by the planned runs. Total charges never exceed the reservation, and settlement does not take additional credits. Unused credits return when all active runs have settled. The paid-test status shows Reserved, Settled and Refunded, with the charge for each run under Runs. Returned credits keep their original expiry; a refund does not turn expired allowance credits into purchased credits. Select Cancel test to stop a queued or running paid test. Unstarted runs are released. In-flight runs must stop and settle before their unused credits return, so cancellation can remain pending for a while.

Credit shortfalls

If the balance cannot cover the high estimate, no test is queued and no credits are reserved. The app shows how many more credits you need and a Buy a credit pack link to Billing. Ask a member with billing permission to buy credits if you cannot. Credits are shared across the account. Other usage can reduce the balance between the estimate and confirmation.

Plans and trials

Agent Picks has its own subscription. Its included credits join the account’s shared pool each month; changing or cancelling it does not change your AI Search subscription. Plus and Pro offer a 14-day trial without a card for eligible accounts. Trial eligibility is account-wide across Agent Picks and AI Search; an account with subscription history subscribes through Billing instead. An Agent Picks trial includes the free starter test and adds no monthly Agent Picks credits. You can run further paid tests during the trial if your shared balance covers the high reservation. A trial does not make custom-job runs available when the app says they are unavailable.

Billing history

Open Billing › Transactions to inspect the account ledger:
  • Agent Picks test, marked Pending, is the high reservation.
  • After settlement, Agent Picks test estimate is marked Replaced by final amount and crossed out.
  • The settled Agent Picks test row shows the final charge. A test that failed settles as Agent Picks test failed.
The replaced estimate and final amount are not two charges. See Credit transactions for the shared ledger.