How to compare HTML skill costs with Claude Code
Sufficient-Storage87 compared direct HTML generation with QingYunA's answer-me-with-html skill. The skill produced fewer output tokens and finished sooner, but extra calls and context left the estimated list-price cost almost unchanged. Each method ran only once.
reddit.com
Suggested prompt
Suggested prompt written by Agents In Use, not the source author. Replace bracketed inputs and review tool permissions first.
Generate an HTML explanation of [topic] using [direct generation or named skill]. Keep [model and effort] fixed and use a fresh session for each comparison. After both runs, compare runtime, model calls, output tokens, total context usage and estimated cost. Review the resulting pages for factual errors. Label one-run observations and list-price estimates clearly; do not present them as a benchmark or actual billed savings.
Reach people exploring AI agents
See placements →Evidence at a glance
Sourced account- Source poster / publisher
- u/Sufficient-Storage87
- Original account
- Read the source ↗
- Published
- Source link checked
- Reported result
- In one run per method, the skill cut output from 10,831 to 3,501 tokens and runtime from 72.7 to 31.8 seconds. It used more calls and total tokens, leaving estimated cost near $0.20 versus $0.19. The author found a misleading diagram and preferred the directly generated page. These were not actual invoice costs.
- Human involvement
- The author selected the same task and settings, started fresh sessions, recorded usage and reviewed page clarity. They identified the incorrect diagram and disclosed confounding factors instead of claiming a controlled benchmark or actual billed saving.
A linked account supports attribution. It does not mean we independently reproduced its result.
Report an issue with this case
Open correction emailOpens your email app with the case link included. Nothing is sent automatically.
How the agent did it
- The author started fresh Claude Code sessions with Sonnet 5.5 at medium effort for the same explanation task.
- They compared direct HTML generation with the answer-me-with-html skill.
- They recorded runtime, output tokens, total tokens, model calls and estimated list-price costs.
Sufficient-Storage87 tested whether an HTML-answer skill reduced the cost of a concrete Claude Code task. Both runs asked for an explanation of context loss on long coding tasks and how persistent memory helps. They used Sonnet 5.5 at medium effort, starting a fresh session for each method.
Direct HTML generation took 72.7 seconds and produced 10,831 output tokens, with an estimated list-price cost of about $0.20. QingYunA's answer-me-with-html skill took 31.8 seconds and produced 3,501 output tokens, with an estimate of about $0.19. The author identifies the skill as version 0.5.5 and explicitly credits its creator rather than claiming it as their own.
The shorter output did not mean proportionately lower total usage. The skill made five model calls rather than one, and the reported total tokens increased from 43,000 to 159,000. The author also judged the direct page clearer. One skill-generated diagram wrongly suggested that a full context window ends a session instead of triggering compaction.
This is a small comparison, not a general benchmark. Each method ran once, a Caveman plugin was active during both runs, and the prices were subscription usage estimates rather than actual invoices. It suits people evaluating agent skills who want to compare complete runs, inspect the resulting artifact and distinguish output-token reductions from a verified saving on the bill.
Prompt
Suggested prompt (written by Agents In Use, not the author's)
Source: Reddit · u/Sufficient-Storage87
Frequently asked questions
Did the HTML skill demonstrably reduce the user's bill?
No. The user was on a subscription and reported list-price estimates of about $0.20 and $0.19, not actual billed savings. Each method ran only once.
Why was fewer output tokens not enough to establish a large saving?
The skill made five calls instead of one and used 159,000 total tokens rather than 43,000. The author also found a misleading diagram, so output size alone did not capture cost or quality.
More details
Remaining steps
- They inspected both pages and identified a misleading context-window diagram in the skill output.
- They disclosed the one-run sample, subscription pricing and Caveman plugin as limitations.
About this account
Claude generated explanatory HTML directly in one run and through a multi-call skill workflow in the other. The agent produced the substantive page content; the user performed the experiment and evaluated its outputs.
Firsthand account by u/Sufficient-Storage87: https://www.reddit.com/r/ClaudeCode/comments/1x8ku98/does_an_answer_with_html_skill_actually_save/. Full public RSS post and returned comments captured on 18 October 2026. Body eligibility passed at 0.96. Outcomes are author-reported, not independently reproduced. Suggested prompt by Agents In Use, not the author's original prompt.
Credit: u/Sufficient-Storage87 on Reddit
Source published
Added to Agents In Use
Source checked
Tools and topics
Claude Code · Sonnet 5.5 · answer-me-with-html v0.5.5 · Caveman plugin
usage measurement · HTML generation · skill evaluation · quality review
Editorial completeness: 100/100. Measures documented fields, not agent performance or verified outcomes.