Claude Docs writes the weekly support trends note

1 month ago

Login tickets at Tollbeck are up forty percent. Thirteen of those tickets are one release bug. I gave Claude Docs two weeks of tickets from Tollbeck, a booking app for small clinics, and asked for the trends note. Claude Docs is Anthropic's new document editor inside Claude. You attach files and ask, and Claude writes a doc you can edit. If you lead a support team, you send this note to product and engineering every Monday. The note says what drove last week's tickets, what changed since the week before, and which tickets prove it. I made up Tollbeck, its clinics and every ticket.

Ask about this presentation

Chapters

  1. 0:00Login tickets rose 40% because one release broke Google sign-in
  2. 0:30Anthropic’s triage guide files a login failure caused by a bug under Bug
  3. 1:04Ten tickets titled “Can’t log in” have three different causes
  4. 1:36A renamed tag and six merged rows change the counts before any math
  5. 2:05A smaller week makes a shrinking category look like it is growing
  6. 2:31Both exports go in with one request for root-cause tags and one list
  7. 2:59Claude Docs split the “Can’t log in” tickets and caught the renamed tag
  8. 3:27Claude Docs misfiled 17 data tickets and inflated its second-biggest driver
  9. 4:05Claude’s doc ranks the drivers, and you decide which one gets engineering time
  10. 4:38Five customers threatened to cancel, and you read each ticket yourself
  11. 5:00You spend 42 of the 47 minutes on checks, urgent tickets and decisions
  12. 5:21The 40% login spike was 13 tickets from one release, filed under login
Show transcript
  1. Login tickets at Tollbeck are up forty percent. Thirteen of those tickets are one release bug. I gave Claude Docs two weeks of tickets from Tollbeck, a booking app for small clinics, and asked for the trends note. Claude Docs is Anthropic's new document editor inside Claude. You attach files and ask, and Claude writes a doc you can edit. If you lead a support team, you send this note to product and engineering every Monday. The note says what drove last week's tickets, what changed since the week before, and which tickets prove it. I made up Tollbeck, its clinics and every ticket.

    Slide text
    Login tickets rose 40% because one release broke Google sign-in
    Login & access · help desk tag
    Sep 14 to 20
    30 rows
    Sep 21 to 27
    42 rows
    +40%
    Help desk tags · every row of both exports
    48469 · Sep 22, 2026 14:32
    Can’t log in
    “Getting ‘Session could not be restored (4012)’ every time I try to sign in with Google.”excerpt
    Login & access Bug · Tuesday’s release
    Tollbeck, its clinics and every ticket are invented
  2. A help desk agent tags each ticket by what the customer typed, so a login loop goes under login. Anthropic publishes skill files, written instructions Claude can follow for one kind of task. Anthropic's ticket triage file for support teams says to tag by root cause. Root cause means what actually broke. The file's own example is a customer who can't log in because of a bug. That ticket counts as a bug. Tag by what customers typed, and a bad release looks like a login spike on the account team's desk. The skill file stayed out of my run. I asked for root cause in my own words.

    Slide text
    Anthropic’s triage guide files a login failure caused by a bug under Bug
    “Categorize by root cause, not just the symptom described”
    Anthropic · knowledge-work-plugins · customer-support/skills/ticket-triage/SKILL.md
    The skill file stayed out of my run · my request asked for root cause in its own words
  3. A trends note is three numbers per category. There's the count for the week before, the count for last week, and the change between them. Each of the three numbers can go wrong in its own way. The first way is the tag. Ten of last week's tickets share one subject line, can't log in. Five of those ten tickets are the release bug. Three are password reset emails that never arrived. Two are customers who typed a wrong password and got locked out. Sort by subject line, and all ten tickets land in one pile. So the first check is to skim every ticket in the biggest category. The three example tickets a note cites can all look right, so read the whole pile.

    Slide text
    Ten tickets titled “Can’t log in” have three different causes
    Count · Sep 14 to 20 Count · Sep 21 to 27 Change
    tickets-week-39.csv · Sep 21 to 27
    ticket subject body · excerpt tag cause
    48451 Can’t log in I pick my Google account and it sends me straight back to the sign-in page. Login & access Release bug
    48469 Can’t log in Getting ‘Session could not be restored (4012)’ every time I try to sign in with Google. Login & access
    48479 Can’t log in I pick my Google account and it sends me straight back to the sign-in page. Login & access
    48500 Can’t log in getting ‘Session could not be restored (4012)’ every time I try to sign in with Google. Login & access
    48515 Can’t log in I pick my Google account and it sends me straight back to the sign-in page. Login & access
    48438 Can’t log in the owner requested a password reset 3 times this morning and nothing has arrived. Login & access Reset email missing
    48475 Can’t log in Two of our therapists requested a password reset 3 times this morning and nothing has arrived. Login & access
    48548 Can’t log in my practice manager requested a password reset 3 times this morning and nothing has arrived. Login & access
    48437 Can’t log in I typed my password wrong a few times and now it says the account is locked for 30 minutes. Login & access Locked out after wrong passwords
    48538 Can’t log in I typed my password wrong a few times and now it says the account is locked for 30 minutes. Login & access
    Check 1skim every ticket in the biggest category
  4. The second check is the category list. Tollbeck's help desk renamed its Billing tag to Payments between the two weeks. Go by the help desk's tags, and Billing disappears while Payments shows up new with twenty-five rows. Put both weeks on one list, and billing tickets fell from thirty-eight to twenty-two. The same check covers duplicates. When a customer writes twice, the help desk merges the follow-up into the first ticket. All six merged rows sit in last week's file. So last week's file holds a hundred and ninety-seven rows but only a hundred and ninety-one tickets.

    Slide text
    A renamed tag and six merged rows change the counts before any math
    ticket subject tag
    48213 Charged twice this month Billing
    48434 Downgrade our plan Payments
    help desk tag Sep 14 to 20 Sep 21 to 27
    Billing 38 (gone)
    Payments (new) 25
    Billing, both weeks 38 22
    tickets-week-39.csv · merged rows
    ticket subject status merged into
    48455 login still not working merged 48454
    48456 Re: Can’t log in merged 48451
    48465 Fwd: Question about the new price merged 48462
    48470 Fwd: Charged twice this month merged 48464
    48524 Set up online deposits (chat) merged 48520
    48609 Fwd: Need a copy of last invoice merged 48600
    Sep 21 to 27 · 197 rows · 191 tickets Sep 14 to 20 · 210 rows · 210 tickets
    Check 2one category list, one ticket per customer problem
  5. The third check is the change itself. How-to questions went from forty tickets to thirty-eight. Last week had fewer tickets overall, a hundred and ninety-one against two hundred and ten. So the how-to slice of the total grew, from nineteen percent to almost twenty. A note that calls how-to a growing problem is reading the slice. Say the count, and give the share only with the count beside it. Counted by root cause, the real rise is bugs, from twenty-four tickets to thirty-five. The help desk's own bug tag went down, from twenty-four to twenty-two.

    Slide text
    A smaller week makes a shrinking category look like it is growing
    Sep 14 to 20 Sep 21 to 27 tickets, by root cause
    How-to
    40
    share 19.0%
    38
    share 19.9%
    Bug
    24
    35
    Account
    30
    27
    Billing
    38
    22
    Integration
    22
    20
    Performance
    20
    18
    Feature request
    18
    16
    Data
    14
    12
    Security
    4
    3
    Check 3say the count, and put the share beside it
    Help desk tag “Bug” · 24 then 22
    Totals · 210 and 191 tickets · my hand count, written before the run
  6. In Claude, I attached both exports as CSV files, a plain spreadsheet format. Then I opened the Output menu and picked Document. My request asked Claude to sort by what broke, on a single set of categories for both weeks. The request also asked for both counts and the change for every category, and three ticket numbers behind each top driver. My request left out the rename, the merged rows and the release. Claude Docs is in beta, an early release, on Claude's Pro, Max, Team and Enterprise plans.

    Slide text
    Both exports go in with one request for root-cause tags and one list
    “available in beta on Pro, Max, Team, and Enterprise plans”
    Anthropic Help Center · Get started with Claude Docs
    Attached
    the two weekly exports · tickets-week-38.csv · tickets-week-39.csv
    Output
    Document
    Tags
    “Tag every ticket by root cause, meaning what actually broke rather than what the customer says happened, and use one category list for both weeks.”
    Per category
    “For each category give last week’s count, this week’s count and the change.”
    Drivers
    “Name this week’s top drivers with three ticket IDs behind each.”
  7. The draft took a hundred and sixty-six seconds, by the conversation's timestamps. Before the run, I wrote down the right count for every category. Claude gave all thirteen release bug tickets a sign-in category of their own. The doc sorts the ten can't log in tickets into their three causes and says so. Claude joined Billing to Payments, dropped the six merged rows and counted a hundred and ninety-one tickets. Claude listed all five urgent tickets, and all forty-three ticket numbers in the doc point at the right tickets.

    Slide text
    Claude Docs split the “Can’t log in” tickets and caught the renamed tag
    One run · invented tickets · my counts written before the run
    Draft · 166 s · measured
    ✓ Release bug tickets in their own category 13 of 13
    ✓ “Can’t log in” split by cause 10 of 10
    ✓ Billing and Payments joined ✓
    ✓ Merged rows dropped 191 tickets ✓
    ✓ Urgent tickets listed by number 5 of 5
    ✓ Ticket numbers cited 43 of 43 real and on topic
  8. On my run, Claude got one category wrong. The doc says each ticket was tagged from its body. Claude's tagging program read the subject line first, and any ticket it couldn't match became a how-to question. Seventeen data and export tickets across the two weeks went that way. So the doc's second biggest driver, customers who can't find a setting, shows forty-six tickets last week against my thirty-eight. One of those seventeen is a clinic asking to export everything before it cancels. The three tickets the doc cites for that driver are genuine, so only the skim from check one finds the problem. The doc also says custom intake form questions doubled, from three tickets to six. I picked those subjects at random, so that move is noise.

    Slide text
    Claude Docs misfiled 17 data tickets and inflated its second-biggest driver
    Its how-to count reads 46 last week · my count is 38
    Claude’s doc · This week’s top drivers · header and row 2
    data and export tickets · three of the 17
    ticket subject Claude’s tag
    48499 Export everything - we are leaving ✗ filed as how-to
    48432 Download invoices as CSV ✗ filed as how-to
    48552 Delete test clients ✗ filed as how-to
    Claude’s how-to count 46
    My count 38
    Noise · I drew these subjects at random
  9. Here is where I'd stop and read it myself. Claude calls the Google sign-in bug the fix to watch. Tollbeck's engineers shipped a fix on Thursday, and the last sign-in ticket came in that morning. So I'd ask why the release checks missed Google sign-in, and move on. The doc lists an Outlook problem under also rising, from seven tickets the week before to nine. Every appointment shows up an hour off in the Outlook calendar. That's sixteen tickets in two weeks, each one marked low priority. Anthropic's triage file says to escalate a repeating pattern even when each ticket is low priority. I'd put the Outlook bug in front of engineering today.

    Slide text
    Claude’s doc ranks the drivers, and you decide which one gets engineering time
    Claude counts
    You decide
    Google sign-in · fixed Thursday · ask why the release checks missed it
    The lead’s call · invented company
    Outlook feed an hour off · 7 then 9 tickets · every one low priority · send to engineering
    Anthropic · ticket-triage SKILL.md
  10. Skip the AI for the angry tickets. Claude listed all five urgent tickets, and each one talks about leaving. I still read all five myself. One clinic writes, we are paying for software we can't open. Another clinic got charged twice for the second month running and plans a bank dispute. A count says how many customers wrote. The note should also quote one of them in their own words. Before I send the note, I call the locked out clinic and the clinic that was charged twice.

    Slide text
    Five customers threatened to cancel, and you read each ticket yourself
    tickets-week-39.csv · priority urgent
    ticket subject priority
    48449 URGENT: whole clinic locked out urgent Call today
    48457 Still can’t log in - cancelling urgent
    48452 Double charged again - disputing urgent Call today
    48499 Export everything - we are leaving urgent
    48429 Calendar down during clinic urgent
    “Third time I’ve written. Still looping on the login page. We are paying for software we can’t open.”excerpt
    48457
    “You charged us twice AGAIN. Second month in a row.”excerpt
    48452
  11. These are desk estimates, and I timed only the draft. By hand, tagging four hundred and seven rows, lining up both weeks and writing the note comes to about a hundred and twenty-four minutes. With Claude Docs, the whole job comes to about forty-seven minutes, and the draft uses under three. Seventeen minutes are checks, and the skim of the biggest category is eight of those. Reading the urgent tickets and deciding take twenty-five minutes on both bars.

    Slide text
    You spend 42 of the 47 minutes on checks, urgent tickets and decisions
    By hand · about 124 min · estimate
    tag 407 rows · 54
    one list, pivot, change · 15
    drivers and ticket IDs · 10
    write the note · 20
    read the urgent five · 10
    decide · 15
    Claude Docs drafting, you checking · about 47 min · estimate
    read the urgent five · 10
    decide · 15
    attach and ask · 2 draft · 2.8 · measured open 18 cited tickets · 6 check the list and merged rows · 3 skim the biggest category · 8
    0 10 20 30 40 50 60 70 80 90 100 110 120 130
    minutes
    Desk estimate for these two exports · the draft was timed
  12. Back to Tollbeck's forty percent. Counted by root cause, account problems fell, from thirty tickets to twenty-seven. The jump came from Tuesday's bug, tagged by what customers typed. Which number in your last trends note was counted differently from the week before?

    Slide text
    The 40% login spike was 13 tickets from one release, filed under login
    Login & access · help desk tag
    Sep 14 to 20
    30 rows
    Sep 21 to 27
    42 rows
    +40%
    By root cause · my count
    Account · Sep 14 to 20
    30
    Account · Sep 21 to 27
    27
    Release bug · Sep 14 to 20
    0
    Release bug · Sep 21 to 27
    13
    48469 · Sep 22, 2026 14:32
    Can’t log in
    “Getting ‘Session could not be restored (4012)’ every time I try to sign in with Google.”excerpt
    Login & access Bug · Tuesday’s release

What happened in AI today, in your inbox

One short email each evening. Read it and you’re caught up.

Built with ❤️ in New York