صفاءSAFAA.IO
LAB · 01

Safaa's Lab

Every week a claim spreads: “this tool cuts 65% of tokens”, “this prompt makes Claude smarter”. Here we test it ourselves and publish the real numbers: speed, tokens, cost, and whether the answer covered the question. Every number comes from Claude Code's own report; every experiment publishes its questions and answers in full (pages in Arabic).

Overstated

caveman: does it really save tokens?

Claim: Repo description: “cuts 65% of tokens”. Their benchmark: 6,983 → 4,119 with caveman, and “Be concise” alone 4,334.

answer tokens vs normal

Answer concisely-31%
caveman-18%

Model: claude-sonnet-5-5 · 10 questions × 1 · 20261019

Open the experiment →

Method: each question goes to Claude Code in an empty folder with no settings and no tools; numbers come from its report (duration_ms, usage). Samples are small and stated per experiment, so a result holds for that experiment only.