Tested on a real live NetSuite Next account · Evaluated 2026-07-08 · Every round backed by an unedited screenshot
The scoreboard
25 rounds. One clear pattern.
Each round sent the exact same prompt to both assistants. We scored outright wins, narrow edges, ties, and Ask Oracle wins honestly, and counted its genuine strengths.
0
CAIA wins
outright, capability or accuracy
0
CAIA edges ahead
both good, CAIA more useful
0
Even matches
no meaningful difference
0
Ask Oracle win
counted fairly
14 CAIA wins8 CAIA edges2 ties1 Ask Oracle win
Bottom line: CAIA finished ahead in 22 of 25 rounds and was never less than even outside a single how-to question.
0%
of rounds, CAIA finished ahead
0/5
action rounds won outright
0/3
Catalyst product rounds won
0
actions Ask Oracle could execute
Verdict share
Hover a slice for the rounds behind it.
Performance by category
Hover a bar segment for detail. Click a row to filter the rounds below.
Agentic actions4/4 ahead
Omnipresence1/1 ahead
Live NetSuite data5/6 ahead
Catalyst products3/3 ahead
How-to & troubleshooting6/7 ahead
Documents2/3 ahead
Escalation1/1 ahead
CAIA winCAIA edgeTieAsk Oracle
The capability gap
Six things CAIA did that Ask Oracle could not do once
These are not style points. In every round below, Ask Oracle either said it could not act or did not know what was on screen. CAIA did the work, behind explicit user confirmation.
Writes to real records
Updated a Sales Order memo through a double confirmation, self-corrected through retries, committed, and verified by reading the record back. Ask Oracle: "I can't make the edit directly here."
Found 10 customers missing an email and staged a one-click bulk update: previewed, chunked, skip-on-error, reversible for 24 hours. Ask Oracle listed the same records and stopped.
Created a customer record with the right subsidiary from one sentence, previewed before committing: "Created customer #2517." Ask Oracle explained where the New Customer form is.
Opened the record in a real NetSuite session, took a before screenshot, edited, saved, distrusted an ambiguous save flag, verified, and showed the after. 21 logged browser actions.
Docked on a live Sales Order, CAIA read the whole record unprompted, filled the Memo on the form, highlighted it, and pointed at Save. Ask Oracle, on the same page, asked for the record ID.
Generated downloadable Word and PDF files and raised a real, context-rich support ticket path. Ask Oracle writes text in the chat window; nothing leaves the drawer.
This is a factual comparison. Ask Oracle is genuinely good at explaining NetSuite, and the scoring reflects that.
01
Identical prompts
Every round sent the same words to both assistants on the same live account, minutes apart.
02
Unedited screenshots
Each verdict is backed by a side-by-side capture of both full answers. Zoom in on any of them.
03
Honest scoring
Ask Oracle's real strengths are counted: it won a round outright and tied several how-to questions.
04
Safe by design
Every CAIA write ran behind explicit user confirmation, with previews, verification read-backs, and undo.
The evidence
All 25 rounds, side by side
CAIA on the left, Ask Oracle on the right. Filter by category, zoom into any screenshot.
01NetSuite how-toCAIA wins
PromptHow do I create a saved search that shows all open sales orders over $10,000?
CAIA Catalyst AI Agent
Actually BUILT the saved search live: record type Sales Order, filters for open statuses (excludes Cancelled/Billed/Closed) AND amount > $10,000, results columns pre-selected, then presented a one-click 'Create in NetSuite' + 'Run Preview' card. Agentic - it does the work for you.
Ask Oracle NetSuite Native AI
Gave correct manual step-by-step instructions (Lists > Search > Saved Searches > New, Transaction type, Sales Order, Main Line = Yes, Amount > 10000, add status/results columns) plus a nuance on Amount vs Amount Remaining. Accurate, but the user must click through every step themselves.
Why it mattersCAIA completes the task with a one-click create; Ask Oracle only narrates the manual steps.
02NetSuite how-toCAIA edges ahead
PromptWhat's the difference between a subsidiary and a location in NetSuite, and when should I use each?
CAIA Catalyst AI Agent
Clear structured explanation (legal entity vs physical/operational place), a 6-row comparison table, 'When to use each', a real-world pattern, and an offer to inspect the connected account's actual subsidiary/location structure. Tagged 'NetSuite context' + 'Caia is confident'.
Ask Oracle NetSuite Native AI
Genuinely strong, thorough conceptual answer with rule-of-thumb, examples (US/UK companies, warehouses/offices), and two modeling mistakes to avoid. Competitive on pure concept explanation.
Why it mattersFor pure conceptual Q&A the two are close; CAIA edges ahead with a clean comparison table and an offer to check the live account structure.
03NetSuite how-toCAIA edges ahead
PromptHow do I set up an approval workflow for purchase orders?
CAIA Catalyst AI Agent
Two routes with concrete NetSuite specifics: Native Approval Routing (Setup > Company > Enable Features > Employees subtab, per-employee PO Approval Limit on the Financial subtab, Accounting Preferences) plus custom SuiteFlow for conditional routing. Named the exact fields and menu paths, and offered to build the SuiteFlow.
Ask Oracle NetSuite Native AI
Solid, well-organized answer: configure approver structure, enable a packaged workflow or build custom SuiteFlow, define start/routing/approve-reject logic, test with a sample PO. Slightly more generic on exact field names, and also offered to help build the SuiteFlow states.
Why it mattersBoth strong; CAIA is more concrete with exact NetSuite field names and menu paths, which saves the user hunting.
04NetSuite how-toAsk Oracle wins
PromptWhere do I configure sales tax nexus settings?
CAIA Catalyst AI Agent
Explained what nexus records are and gave the typical path (Setup > Accounting > Nexuses / Set Up Taxes), the fields on a nexus record, and the SuiteTax-vs-classic caveat. Honest that it lacked live verification on this pass and flagged 'Caia isn't sure', pointing to global search and the Escalate to Support option.
Ask Oracle NetSuite Native AI
Crisp and precise: gave the exact split paths for legacy/Advanced Taxes (Setup > Accounting > Taxes > Set Up Taxes / Nexuses > New) vs SuiteTax (Setup > Tax > Nexuses > New). Cleanest, most confident answer of the two here.
Why it mattersA fair loss for CAIA: Ask Oracle gave more precise menu paths and CAIA hedged. Credit where due on native navigation trivia.
05Live NetSuite dataCAIA edges ahead
PromptHow many open sales orders do we currently have, and what is their total value?
CAIA Catalyst AI Agent
Ran 1 live SuiteQL query against the real account and answered in ~28s: 277 open sales orders, total value $4,826,714.50, plus a plain-English definition of which statuses count as open (excludes Cancelled/fully Billed/Closed) and an offer to break it down by status or rep. Tagged 'NetSuite context' + 'Caia is confident'.
Ask Oracle NetSuite Native AI
Also pulled live data (it can query the account), landing on the same 277 count but a different total: $4,265,052.16, which it labeled the open/remaining value under the Parent Company hierarchy. It took roughly 134 seconds across three separate reasoning passes to reconcile the count against the report rows.
Why it mattersBoth query real data and agree exactly on the count (277), which validates both are hitting the live account. CAIA was ~5x faster (28s vs ~134s) and defined its terms up front; Ask Oracle was slower but its 'open remaining' figure is a reasonable alternate reading. The value gap is a definitions difference (gross order amount vs remaining open amount), not an error.
06Live NetSuite dataCAIA wins
PromptWho are our top 5 customers by total revenue this year?
CAIA Catalyst AI Agent
Ran 2 SuiteQL queries against invoices and cash sales and returned a complete ranked table of all 5 customers with a 'Copy CSV' button: Crazy Commerce ($19.8M), Midtown Dental Group ($11.79M), 188 Palm Springs ($1.98M), Admiral Express ($21,414), 166 Auto Auction ($100). It then flagged the steep drop-off and warned the round numbers look like test/demo data that should be verified against production before real reporting.
Ask Oracle NetSuite Native AI
Leaned on the packaged 'Sales by Customer Summary' report and concluded there were 'fewer than five customers to rank', surfacing only ONE: Admiral Express at $21,314. It offered a link to the full report for a broader breakdown.
Why it mattersClear CAIA win. By querying the transaction tables directly, CAIA surfaced all 5 customers and the true revenue leaders; Ask Oracle's report-based path missed 4 of the 5 and reported the account as nearly empty. CAIA also added analyst-grade judgment by flagging the data as likely demo data. Same account, very different completeness.
07Live NetSuite dataCAIA edges ahead
PromptList the inventory items that are currently below their reorder point.
CAIA Catalyst AI Agent
Thought for 110s and queried location-level reorder configuration directly. Correctly returned zero items and, crucially, explained WHY: reorder point is tracked per item per location (not a single record field), no location-level reorder points are configured in this account, and several items use Auto Reorder Point (demand-calculated). Gave 3 concrete checks and offered to build a reorder-point saved search. Honestly self-tagged 'Caia isn't sure'.
Ask Oracle NetSuite Native AI
Also correct: it found the standard 'At or Below Reorder Point' filter on the Current Inventory Snapshot report, reran the query in that exact shape, and returned no items at or below reorder point under the default hierarchy. Clean and accurate, with an offer to narrow by location/subsidiary.
Why it mattersBoth landed on the correct answer (none), and Ask Oracle gets real credit for using the exact right native report filter. CAIA's edge is explaining the root cause (reorder points aren't configured, plus the per-location data-model nuance and Auto Reorder Point) and giving the user a path to fix it, not just the empty result.
08Live NetSuite dataCAIA wins
PromptWhich invoices are overdue by more than 30 days, and what is the total outstanding?
CAIA Catalyst AI Agent
Ran 4 SuiteQL queries and answered inline: 845 open invoices overdue >30 days totaling $4,733,851.79, plus a Top 10 largest overdue table (Copy CSV) and a standout root-cause finding: BlueWeb, Company holds 9 of the top 10, all dated 12/11/2020 with matching due dates (~$1.66M, 5.5+ years past due), which it flagged as an uncollected batch billing event worth writing off, disputing, or reconciling. Offered an Excel/CSV export.
Ask Oracle NetSuite Native AI
Loaded an 'ns-overdue-customer-analysis' skill and reasoned methodically for ~180 seconds across five passes (correctly deciding to treat Open as collectible and exclude Pending Approval). But the deliverable was an 'Overdue receivables snapshot' card with NO count or total shown inline; the user has to open the separate snapshot artifact to see any numbers.
Why it mattersCAIA win on both speed and usefulness. CAIA put the count, the dollar total, a ranked table, and an actionable root-cause insight directly in the conversation. Ask Oracle's careful status-mix reasoning is respectable, but after three minutes it handed back an empty-looking snapshot card instead of the answer, so the user still has to go dig.
09Live NetSuite dataCAIA wins
PromptHow much have we invoiced this month compared to last month?
CAIA Catalyst AI Agent
Ran 3 SuiteQL queries. Found both the current and prior calendar month at zero, recognized that as unusual, and instead of stopping there it scanned invoicing activity by month and returned a 6-row table (Copy CSV): the biggest being March 2026 with 391 invoices totaling ~$33.5M, plus smaller months. It flagged the March spike as worth a sanity check (batch billing run or bulk import), noted the total gap in April 2026, and offered to drill into March or use a trailing-30-day window.
Ask Oracle NetSuite Native AI
Also queried directly and correctly reported: invoiced 0 this month, 0 last month, so the month-over-month change is 0. It offered to redo the comparison by posting period or broken down by customer/subsidiary. Accurate, but it stopped at the literal zero-vs-zero result.
Why it mattersBoth computed the same literal answer (zero both months), so the difference is judgment. Ask Oracle returned '0 vs 0' and waited. CAIA realized a double-zero is a red flag, went and found where the invoicing activity actually lives (the $33.5M March spike), and handed back something the user can act on. That proactive next-step reasoning is the whole point.
10Live NetSuite dataEven match
PromptWhich sales rep has the most open opportunities right now?
CAIA Catalyst AI Agent
Ran 5 SuiteQL queries (119s). Reported 23 open opportunities (status In Progress), found Peter Lee as the only rep with an explicit assignment (3 of 23), and gave an honest caveat that the salesrep field was blank for 14 of 15 customers checked plus a transient SuiteQL parse error on the per-transaction field. It declined to declare a definitive leader on incomplete data and recommended a saved search on Opportunities grouped by Sales Rep, offering to build it.
Ask Oracle NetSuite Native AI
Reasoned across roughly eight passes and concluded: Peter Lee has the most assigned open opportunities. Of 42 open opportunities across all subsidiaries, the Sales Rep/Employee field was populated on only 2, both Peter Lee, and it clearly noted the other 40 are unassigned. Offered to break out the unassigned set or check a different rep-assignment field.
Why it mattersA genuine tie and a credibility check for this report. Both agents hit the same real data limitation (opportunities are almost entirely unassigned in this sandbox) and both handled it honestly, naming Peter Lee while being explicit that it is only the leader among a tiny populated set. Different status filters explain the 23-vs-42 count. Neither guessed; both were transparent.
11Catalyst product knowledgeCAIA wins
PromptWhat is the Catalyst ConnectWise integration and what does it do?
CAIA Catalyst AI Agent
Deep, accurate, product-specific answer straight from Catalyst's own documentation: the ConnectWise PSA (Manage) SuiteApp, the full three-stage architecture (Import to staging records -> Convert to native NetSuite records -> Sync-Back to ConnectWise), the exact record mappings (CW Company -> Customer/Vendor, CW Invoice -> Invoice/Credit Memo, CW Time Entry -> Time Bill/JE, etc.), the Vue.js monitoring dashboard, Run Logs, and the CW Settings configuration record. Crucially noted live account awareness: 'I can see your Dev account has multiple CW Settings records configured this way.' Tagged 'NetSuite context' + 'Caia is confident'.
Ask Oracle NetSuite Native AI
Did NOT actually know the product. Spent ~3.5 minutes across five reasoning passes (12s + 5s + 12s + 2min + 25s) and then admitted: 'I didn't find a clearly identified item named exactly Catalyst ConnectWise integration.' Fell back to a generic guess based on the name -- 'this appears to be a NetSuite-to-ConnectWise connector... this kind of integration usually supports one or more of these data flows' -- then listed hypothetical flows and offered to inspect the account.
Why it mattersOn Catalyst's own product, CAIA answers precisely from product knowledge and even reads the live config; Ask Oracle has no knowledge of it, burns 3.5 minutes, and can only guess from the name.
12Catalyst product knowledgeCAIA wins
PromptHow do I configure the Catalyst ConnectWise integration to sync tickets and time entries into NetSuite?
CAIA Catalyst AI Agent
SME-level, product-specific walkthrough. Led with the key nuance (Service Tickets import to a staging record with no native NS conversion target and exist as reference/context; Time Entries actually convert to an NS Time Bill or Journal Entry). Gave the exact navigation path (Catalyst tab -> Dashboard Center -> View -> ConnectWise Integration card -> Setup -> View and Edit Settings), the real custom record id (customrecord_ctc_cw_setup), the per-entity Run Option values (Import and Convert / Import Only / Disabled), the full Time Entry conversion settings (employee mapping, hours setting, billable option, item mapping, convert-to-Journal-Entry list, auto-approve), the required conversion/dependency order (Members -> Employees first), and offered to read the live CW Settings (noting there are 22 CW accounts in this sandbox to pick from).
Ask Oracle NetSuite Native AI
Reasonable but fully generic PSA-integration checklist: map members to employees, map service items/work roles, restrict initial scope to one board/date range, run a manual pilot, verify employee/customer/item/billable, then schedule. Listed common failure causes. Explicitly conceded: 'Because no account-specific Catalyst ConnectWise help topic surfaced here, this is the most reliable setup checklist rather than a guaranteed click-by-click path for your exact bundle,' and asked the user to share the bundle/setup page name or a screenshot. Took ~168 seconds.
Why it mattersCAIA gives the exact record, fields, Run Options and conversion order from Catalyst's product knowledge plus offers to read the live config; Ask Oracle can only offer a generic best-practice checklist and asks the user for more info.
13Catalyst product knowledgeCAIA wins
PromptWhat Catalyst integrations are available for NetSuite, and what problem does each one solve?
CAIA Catalyst AI Agent
Returned a 13-row table of the Catalyst integrations actually LICENSED on this account (tstdrv1716438) -- ConnectWise, Autotask, Halo, VAR Connect, Channel Online, ConnectBooster, IT VAR bundle, Service Contracts, Sales Commissions, Project Hub, HubSpot, Projects to Office 365, Float -- each with live status (flagging Autotask/Float/HubSpot/Service Contracts as 'Active, in implementation') and a one-line problem-solved. Included Copy CSV, and closed by naming which are most actively used (ConnectWise, Halo, Autotask, VAR Connect, IT VAR). Straight from the live license record.
Ask Oracle NetSuite Native AI
Misread the question entirely -- it doesn't know 'Catalyst' is a vendor/product line. Answered about NetSuite's OWN native integration mechanisms (SuiteTalk SOAP/REST, RESTlets, Suitelets, CSV import/export, SuiteAnalytics Connect via ODBC/JDBC/ADO.NET) and the tradeoffs between them. Offered to identify which of THOSE are enabled. Zero awareness of the Catalyst product catalog or this account's licenses.
Why it mattersAsked about Catalyst's product lineup, CAIA reads the live license register and lists all 13 with status and purpose; Ask Oracle doesn't recognize the vendor and answers a different question about generic NetSuite integration tools.
14TroubleshootingCAIA edges ahead
PromptA customer says their invoice isn't showing the right sales tax. Walk me through diagnosing why.
CAIA Catalyst AI Agent
Structured diagnostic: confirm SuiteTax vs Legacy Tax, then check the tax-driving (ship-to) address, the customer's taxable status and tax code/item, header vs line-level tax, and any manual override. Concise and correct. Closed with the differentiator: offered to pull the actual invoice from the connected account and check header tax code, ship-to address, customer taxable status and line-level tax to tell the user exactly which field is off, rather than working the checklist by hand.
Ask Oracle NetSuite Native AI
Genuinely strong native answer -- sales tax is core NetSuite territory. Walked through SuiteTax vs Legacy differences, scoping the problem (one invoice vs one customer vs one state vs all recent), verifying the shipping/billing address fields (country/state/postal/city), checking nexus/jurisdiction, tax codes, and recalculation. Thorough and well organized (~68s).
Why it mattersOn a core NetSuite topic the two are close and both correct; CAIA's edge is that it can pull the actual invoice and name the exact bad field instead of only narrating the checklist.
15TroubleshootingCAIA edges ahead
PromptOur inventory counts look wrong after a recent CSV import. How do I find and fix the discrepancy?
CAIA Catalyst AI Agent
Practical diagnostic: open the CSV import job in Import Status to see what it actually touched, note that a standard Item import does not update Quantity on Hand (so a 'wrong count' is often a display/expectation issue vs a real change), isolate affected items, compare against inventory-affecting transactions, and correct via an Inventory Worksheet/Adjustment. Showed good judgment by cautioning that a bad reconciling entry throws off COGS and asset value, and recommended the Escalate to Support button so the team can review the exact import log before posting corrective adjustments.
Ask Oracle NetSuite Native AI
Also strong and accurate: check the import job in Import Status, confirm the record type and whether it created transactions or only updated item master, correctly flagged that a normal Items import generally does not update Quantity on Hand and that quantity corrections go through an Inventory Worksheet or quantity-affecting transactions. Solid native guidance (~64s).
Why it mattersBoth give correct, well-reasoned import-troubleshooting paths; CAIA adds a risk caution (COGS/asset impact) and a one-click escalation to have the team review the actual import log before corrections are posted.
16TroubleshootingCAIA edges ahead
PromptA scheduled script failed last night. How do I find the error and what likely caused it?
CAIA Catalyst AI Agent
Concise, correct path: go to Scheduled Script Status (Customization > Scripting), filter to last night and the deployment, open the execution log to read the error/stack, and check the deployment status. Then gave the most common root causes (governance/usage limits exceeded, uncaught error on an edge-case record in the queue, script/deployment set inactive, permission or data-dependency issues). Closed with the differentiator: 'If you can tell me which script failed (name or script ID), I can pull its deployment status and recent activity directly from your account and narrow this down further.'
Ask Oracle NetSuite Native AI
Also solid: after ~4 short reasoning passes, pointed to Customization > Scripting > Scheduled Script Status, filter to last night and the script/deployment, open the execution log, and separated 'where to look' from the likely cause categories (governance limits, uncaught exceptions, bad data, inactive deployment). Good native guidance (~76s).
Why it mattersBoth correctly route to Scheduled Script Status and the execution log; CAIA's edge is offering to pull the specific script's live deployment status and recent activity from the account to pinpoint the failure.
17Document generationCAIA edges ahead
PromptGenerate a one-page summary report of our current open AR aging.
CAIA Catalyst AI Agent
Ran 4 SuiteQL queries and produced the full one-page report INLINE: Total Open AR $5,280,941.58, an aging-bucket table with percentages (89.6% is over 90 days past due), a Top-10 customers-by-open-balance table, and a consulting-grade read (flat curve with a huge over-90 bucket = a stale batch, not active collections; BlueWeb $1.89M from 12/11/2020, Crazy Commerce 540 invoices, the two = 61% of AR; recommends a cleanup pass, not a collections call). Even referenced prior context ('as we've discussed before'). Then offered to export it as a polished downloadable Word or PDF with a real aging chart. ~2.5 min.
Ask Oracle NetSuite Native AI
Also pulled live AR data and, after ~6 minutes of reasoning, created a native 'Open A/R Aging Summary' artifact card ('highlights the aging mix, customer concentration, and includes the underlying A/R Aging report'). Genuinely capable -- but the numbers live inside the artifact card the user must open, nothing is shown inline, and there's no downloadable Word/PDF document.
Why it mattersBoth can build the summary from live data; CAIA is ~2.5x faster, shows the full numbers and insight inline, and offers a real downloadable Word/PDF, while Ask Oracle takes ~6 min and hides the result in a native artifact card with no Office export.
18Document generationEven match
PromptDraft a customer-facing email explaining a delayed shipment and the next steps we're taking.
CAIA Catalyst AI Agent
Drafted the email in ~25s as a real, structured email object: subject line 'Update on Your Order -- Shipment Delay Notice', TO/SUBJECT header fields, a warm personal opening, and labelled sections (What Happened / Updated Timeline / What We're Doing) with placeholders for order number and dates. Rendered with one-click 'Copy All', 'Copy Body', and 'Open in Mail' actions plus quick-tone chips ('Add a goodwill discount', 'Make this more formal/less formal') and an escalation option. Tagged 'Caia is confident'.
Ask Oracle NetSuite Native AI
Also drafted a solid, professional email (~16s): 'Subject: Update on Your Shipment', empathetic opening, a clear next-steps bullet list (confirm status with warehouse/carrier, prioritize dispatch, send tracking), placeholders, and an offer to tailor it. Fully competitive on the writing itself, with a Copy-to-clipboard button.
Why it mattersPure copywriting is a level playing field -- both produced strong, ready-to-use emails. CAIA's small edge is delivering it as a formatted email object with Open-in-Mail and one-click tone adjustments, but on content quality this one is an honest tie.
19Document generationCAIA wins
PromptCreate a Word quick-start guide for a new AP clerk on entering vendor bills.
CAIA Catalyst AI Agent
Actually produced the Word file. Outlined the guide (navigation, required fields, PO matching, approval submission), asked one smart clarifying question (AI visuals vs clean text-only), then on confirmation generated a genuine downloadable document: 'Vendor Bill Entry Quick-Start Guide for AP Clerks.docx' with a Word-document icon and a Download button. It also reviewed the live account while building it and cautioned that the Pending Approval step should be verified against this specific setup.
Ask Oracle NetSuite Native AI
Wrote a solid quick-start guide as text and said it is 'ready to copy into Word,' created as a native 'Quick-Start Guide: Entering Vendor Bills in NetSuite' artifact with a Copy-to-clipboard button. Good content, correctly caveated that field names vary by form/role -- but there is NO Word file and NO download; the user must copy-paste it into Word themselves.
Why it mattersThe task was literally 'create a Word guide.' CAIA delivers an actual downloadable .docx; Ask Oracle can only produce text to copy into Word by hand. Real document generation is a CAIA-only capability.
20Support escalationCAIA wins
PromptI've been fighting a bank reconciliation mismatch for over an hour and I'm stuck. I need a human to help.
CAIA Catalyst AI Agent
Recognized the emotional cue and escalated: acknowledged the frustration, said 'I'll raise a support ticket now with the context I have so the team can jump in quickly,' and surfaced a real escalation banner -- 'It looks like this may need human attention. Would you like me to raise a support ticket?' with a one-click 'Raise a Ticket' button that packages the account, the bank-rec mismatch, and the time already spent so the Catalyst team can start without the user re-explaining. It also offered to look at the live data to try to shortcut before support picks it up. (We captured the offer and deliberately did not click Raise a Ticket.)
Ask Oracle NetSuite Native AI
Offered to help route it: 'I can help get this to the right person. Which bank account and reconciliation date are affected, and do you want live troubleshooting or a clean handoff summary for the human reviewer?' It can prepare a handoff summary -- but there is no actual escalation path, no ticket, and no destination team; the user still has to find and contact a human themselves.
Why it mattersCAIA has a real human-in-the-loop escalation: a one-click ticket to the Catalyst support team with full context. Ask Oracle can only offer to write a handoff summary with nowhere to send it.
21Agentic - Browser OperatorCAIA wins
PromptUse your browser operator to open the most recent Sales Order in NetSuite. Take a screenshot of it, then set its Memo field to 'Reviewed by CAIA 2026-07-08' and save the record. Show me the before and after.
CAIA Catalyst AI Agent
Went fully agentic through the Browser Operator. She ran a quick SuiteQL query to find the most recent Sales Order (155, internal ID 24207), then drove a real logged-in NetSuite browser session: opened the record, captured a 'before' screenshot with the Memo field highlighted, switched to edit mode, filled Memo = 'Reviewed by CAIA 2026-07-08', and saved. The save call returned an ambiguous result: false, so instead of trusting it she read the record fields back directly, confirmed the Memo genuinely persisted, and captured an 'after' screenshot showing the highlighted field and NetSuite's 'Transaction successfully Saved' banner. 21 browser actions logged end to end; only the Memo changed, everything else (customer, totals, dates) untouched.
Ask Oracle NetSuite Native AI
Found the same order (1051913, TEST CUSTOMER, 03/16/2026, Pending Fulfillment, $100, Memo blank) via a read query, then stated flatly: 'I'm not able to save record edits from here.' It can only tell the user to open the record, set the Memo, and Save it manually. No write capability of any kind, and no browser.
Why it mattersThe browser-operator counterpart to CAIA's RESTlet write: she opened the actual NetSuite UI in a live session, edited the Memo, saved, and captured before/after proof. Notably she distrusted an ambiguous save-status flag and read the record back before claiming success, rather than assuming. Ask Oracle has no browser and no write; it can only tell you to make the edit yourself.
22Agentic - Write to a recordCAIA wins
PromptSet the Memo field on Sales Order internal ID 729 (transaction #9, Globe Telecom CTC) directly in NetSuite, then read it back to confirm it saved. (CAIA was asked to write 'CAIA verified write test'; Ask Oracle was then asked to write a different value, 'Ask Oracle write test', to the same field.)
CAIA Catalyst AI Agent
Ran a live SuiteQL check to confirm SO #9 / internal ID 729 (Memo was blank), then queued the write behind a two-step confirmation: a write card (Confirm & Execute) plus a 'Ready to update this record?' modal. On confirm she wrote to NetSuite through the RESTlet, self-corrected through transient timeouts and a rate-limit over 4 attempts, and committed Memo to 'CAIA verified write test' on salesorder #729 with a View in NetSuite link. Verified independently by SuiteQL after the run.
Ask Oracle NetSuite Native AI
Asked to set the Memo to a different value ('Ask Oracle write test'), it identified the right record (Sales Order 9, Globe Telecom CTC) and read the current Memo back as 'CAIA verified write test' (the value CAIA had written), then said plainly: 'I can't make the edit directly here, so I wasn't able to change the Memo... You can update the Memo... and once it's saved, I can verify the new value for you.' It has no write capability; it reads and hands the edit back to you.
Why it mattersA real, verified write versus an explicit 'I can't make the edit directly here.' CAIA committed the change end to end behind a double confirmation with self-correcting retries; Ask Oracle, asked to write a different value, could only read back the value CAIA had already set and tell the user to do the edit themselves. Agent that acts vs assistant that describes.
23Agentic - Mass UpdateCAIA wins
PromptSearch for the 10 most recent customers that don't have an email, then do a mass update and put a placeholder email 'placeholder@mycompany.com' on all those customer records and save it.
CAIA Catalyst AI Agent
Found the 10 most recent customers with no email, then built a real bulk-update plan: a 'Mass update - customer' card covering all 10 records (Email to placeholder@mycompany.com) with a 5-record sample preview, processing in safe chunks with a live progress bar, an 'if a record can't be updated: keep going (skip it)' option, and a 24-hour Undo. She also proactively flagged that one shared placeholder across all 10 means you can't tell them apart by email later, and offered a unique-per-customer alternative. One click on 'Update 10 records' runs it; nothing was written until confirmed.
Ask Oracle NetSuite Native AI
Given the same task, it identified effectively the same 10 customers with a blank email (near-identical list, by Date Created), then said plainly: 'I was able to identify the records, but I can't execute and save a mass update to those customer records from here.' It offered to explain the manual saved-search plus Mass Update route. Read and list only, no write, no execution.
Why it mattersSame read, opposite outcome. Both pinpointed the 10 email-less customers, but only CAIA turned it into an executable bulk update: previewed, chunked, skip-on-error, with a 24-hour undo and a thoughtful nudge about reusing a single placeholder. Ask Oracle can identify the records and narrate the manual Mass Update path, but by its own words 'can't execute and save' anything itself.
24Agentic - Create RecordCAIA wins
PromptCan you create a customer record, name it 'Test Company AI 1', select the Parent Company subsidiary, and save.
CAIA Catalyst AI Agent
Resolved the subsidiary first (checked the account and found Parent Company = subsidiary ID 1), then showed a 'You're about to create a new record in NetSuite' card (record type: customer; fields companyname='Test Company AI 1', subsidiary=1) behind a double confirmation. On confirm the write engine ran (Validating -> Inspecting record type fields -> Creating record) and committed: 'Created customer #2517', with a summary ('assigned it to Parent Company as the subsidiary') and a View in NetSuite link. A real new record created end to end.
Ask Oracle NetSuite Native AI
Given the identical prompt, it resolved the same subsidiary (best active match Parent Company) but said plainly: 'I can't create and save the customer record directly here.' It listed the manual path (Customers > Enter Customers, set Company Name and Subsidiary, Save) and helpfully flagged several similarly named existing customers (TEST Company 1, Test Company (1), XYZ Test Company (1), and others) to check against duplicates. Good guidance, zero execution.
Why it mattersA brand-new customer record created through the RESTlet engine versus step-by-step instructions to create it yourself. Both resolved the subsidiary and both added value (CAIA previewed the write; Ask Oracle flagged possible duplicates), but only CAIA actually created and saved the record. Create is the same story as write and mass update: CAIA acts, Ask Oracle narrates.
25Omnipresence - Onscreen field write + guidanceCAIA wins
Prompt(While viewing Sales Order #20 in NetSuite) Can you analyze this sales order and put a nice memo description on it?
CAIA Catalyst AI Agent
Omnipresence mode: Caia was docked on the live Sales Order #20 record itself. Without being told which record, she already had the full context -- TEST CUSTOMER, the single StarTech 8-pin Lightning-to-USB line (item 50253, 5 at $13 = $65), fully fulfilled and billed, ship 4/11 promise 4/13, flagged excluded from outbound sync. She drafted a memo, wrote it straight onto the form's Memo field (highlighted in orange), popped an onscreen tooltip explaining exactly what she set and why, and pointed guidance at the Save button -- while deliberately not saving ('I won't save it for you'), leaving the commit to the user. She was also honest that she didn't have a verified read-back yet and asked the user to eyeball the field.
Ask Oracle NetSuite Native AI
Given the identical prompt while sitting on the very same Sales Order #20 page, Ask Oracle had no idea which record was open: 'I can do that, but I need the specific sales order first. Please send the sales order number, internal ID, or paste the record link so I can review it.' No screen awareness, no field context, and no way to touch the form -- the Memo field stayed empty.
Why it mattersThe capability Ask Oracle structurally cannot match. Both were looking at the same Sales Order, but only CAIA actually knew it -- she read the whole record off the page, wrote the Memo directly onto the form, highlighted the field, explained it with an onscreen callout, and guided the user to Save, all without committing on their behalf. Ask Oracle, on the same screen, asked the user to paste the record ID. Omnipresence -- onscreen read plus field-fill plus guidance -- is a different category, not just a better answer.
See CAIA on your own NetSuite account
Everything in this report ran on a standard NetSuite account with CAIA installed. Ask us for a live demo and run your own prompts.
CAIA Catalyst AI Agent
