Benchmarks

Benchmarks

Round 13, measured 2026-10-18 on phase 2 d8dcc5a. Five browser samples, Playwright Chromium, a 640×360 line, three x spacings. This page does not re-time the libraries. The same numbers are in benchmarks.json (schema benchmarks.schema.json) and benchmarks.md. The agent eval was not re-run; it stays 2026-10-16.

The aligned update starts at the top of a requestAnimationFrame. The harness awaits the library's own completion, then reads the clock from a MessageChannel task after that frame's style, layout, and paint. GPU and raster time is not in the number. ChartKit is measured through mount(element, spec).update(spec), the same shape as uPlot's setData. The figure is the median of five samples.

Paint

Two-rAF completion, animation and tooltips off, sampling auto. Median of 5 at 640×360. Run date 2026-10-29. Phase 3 rival cells in the same file stay from 2026-10-28. A cell is initial ms / update ms. DNF means the run errored or timed out. N/A means that library has no native chart of that type. An em dash means this run did not include that cell. Spike is ChartKit only; every rival is N/A. The line row is sampling auto at 100,000 points. The sampling-none rows are the dense line, ChartKit only. This is not a hover-steady time.

Candlestick in the table is 100,000 candles, the size the other libraries were timed at. ChartKit also finished 2,000 candles at 23.8 ms initial and 18.9 ms update.

Other line sizes (1,000, 10,000, and the 1,000,000-point sampling-auto cell) and the canvas line stay in paint.json. They are not extra rows here. Bundle size and server render are not in this matrix.

ChartPointsChartKituPlotChart.jsEChartsRechartsNivoObservable PlotHighchartsPlotly.jsVictoryvisxApexChartsTremorVega-LiteAG ChartsamCharts 5Google ChartsTradingView Lightweight ChartsMUI X ChartsMermaidAntV G2
Line100,00014.2 / 30.814.7 / 30.558.7 / 33.42491.8 / 2739.91884.3 / 1002.0383.2 / 980.2109.5 / 1481.0——————————————
Line, sampling none100,00054.0 / 1157.2————————————————————
Line, sampling none1,000,000466.7 / 21550.2————————————————————
Bar4812.1 / 29.812.0 / 32.326.4 / 21.434.7 / 15.849.8 / 19.155.2 / 20.417.4 / 29.6——————————————
Pie87.6 / 33.2N/A14.5 / 33.125.6 / 18.528.5 / 22.523.5 / 21.2N/A——————————————
Donut88.8 / 33.5N/A11.7 / 33.525.3 / 23.927.7 / 17.123.6 / 19.4N/A——————————————
Stacked area100,00045.6 / 51.6N/A737.4 / 670.018700.4 / 18445.8DNFDNF563.3 / 5252.7——————————————
Scatter100,00062.4 / 40.0132.0 / 121.1269.3 / 247.18827.4 / 9060.55815.9 / 11446.6410.6 / 339.8519.0 / 624.9——————————————
Combo4814.2 / 28.1N/A28.5 / 17.036.9 / 23.956.9 / 23.5N/AN/A——————————————
Heatmap1,20015.9 / 24.1N/AN/A49.1 / 25.5N/A426.4 / 446.822.9 / 22.7——————————————
Gauge115.3 / 28.4N/AN/A24.9 / 24.9N/AN/AN/A——————————————
KPI117.7 / 25.9N/AN/AN/AN/AN/AN/AN/A67.9 / 13.2N/AN/AN/A47.3 / 66.7N/AN/AN/AN/AN/AN/AN/AN/A
Sparkline100,00018.7 / 15.2N/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/A182.1 / 1875.6N/A180.8 / 75.0N/AN/AN/A167.7 / 1828.3N/AN/A
Mini area100,0009.5 / 21.410.5 / 21.047.4 / 28.6122.4 / 78.8233.0 / 132.2310.1 / 270.957.8 / 56.2——————————————
Progress ring115.1 / 29.6N/AN/AN/AN/AN/AN/A28.8 / 28.5N/AN/AN/A33.6 / 17.645.3 / 66.6N/A117.9 / 6.7N/AN/AN/A22.6 / 22.3N/AN/A
Spike100,00056.6 / 43.3N/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/A
Candlestick100,000181.5 / 153.8N/AN/A2840.8 / 2626.4N/AN/AN/A2954.5 / 2913.3101610.6 / 60983.6N/AN/ADNFN/AN/A212.0 / 69.97145.0 / 131435.45314.0 / 10612.3281.3 / 155.0N/AN/AN/A
Histogram100,00030.8 / 17.3N/AN/AN/AN/AN/A45.7 / 40.1——————————————
Box plot100,00056.7 / 40.1N/AN/A70.8 / 53.2N/A86.5 / 69.7222.2 / 184.3——————————————
Radar810.0 / 33.1N/A21.8 / 27.529.0 / 19.336.1 / 16.227.1 / 17.4N/A——————————————
Funnel815.5 / 27.6N/AN/A23.5 / 25.924.3 / 14.229.9 / 20.0N/A——————————————
Treemap4819.3 / 23.2N/AN/A34.3 / 950.332.7 / 17.341.6 / 19.5N/A——————————————
Sankey4817.3 / 24.2N/AN/A31.4 / 20.626.9 / 18.541.7 / 24.6N/A——————————————
Bullet615.9 / 28.6N/AN/AN/AN/A43.2 / 20.4N/A——————————————
Waterfall1216.8 / 25.8N/AN/AN/AN/AN/AN/A33.5 / 24.180.3 / 19.2N/AN/A43.6 / 11.9N/AN/A144.2 / 19.5N/AN/AN/AN/AN/AN/A
Range area100,00028.0 / 22.445.8 / 34.8377.5 / 341.4N/AN/AN/A230.9 / 4285.1——————————————
Range bar2418.1 / 24.815.3 / 33.424.9 / 23.4N/A47.0 / 21.1N/A15.4 / 25.7——————————————
Error bar2417.2 / 22.6N/AN/AN/A59.1 / 23.7N/AN/A——————————————
Gantt2410.6 / 30.3N/AN/AN/AN/AN/AN/A68.9 / 26.6N/AN/AN/AN/AN/AN/AN/A237.9 / 105.8188.7 / 31.5N/AN/A75.3 / 14.7N/A
Timeline1610.3 / 29.8N/AN/AN/AN/AN/AN/A47.4 / 23.0N/AN/AN/AN/AN/AN/AN/AN/A233.1 / 27.7N/AN/A82.4 / 20.5N/A
Quadrant249.6 / 33.6N/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/A152.2 / 16.3N/AN/AN/AN/A78.5 / 19.5N/A
Venn313.2 / 26.9N/AN/AN/AN/AN/AN/A34.1 / 29.1N/AN/AN/AN/AN/AN/AN/A38.2 / 44.0N/AN/AN/A77.2 / 12.3N/A
Journey1210.6 / 30.9N/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/A76.2 / 14.4N/A
Radial bar1215.2 / 27.3N/AN/A31.1 / 19.229.4 / 12.433.4 / 25.4N/A——————————————
Rose1215.0 / 26.7N/A20.2 / 28.426.4 / 19.3N/AN/AN/A——————————————
Sunburst4818.2 / 23.2N/AN/A29.5 / 18.429.5 / 21.335.9 / 13.0N/A——————————————
Bar list2026.8 / 33.3N/AN/AN/AN/AN/AN/AN/AN/AN/AN/AN/A46.0 / 66.5N/AN/AN/AN/AN/AN/AN/AN/A

Bundle size

Gzip bytes. esbuild minify, gzip level 9. Measured 2026-10-29, commit 55fc89d. ChartKit is createRenderer of that one chart. /all is 78,081 gzip, one bundle for every core chart and every theme, without the validator. It is not a column. A number is an ok cell. unsupported means that library has no native chart of that type, or is not an npm package. not tree-shakeable means the per-type cell does not repeat the full-package size. error and timeout are labeled when a cell failed. Commercial libraries were run without license keys. Google Charts isn't an npm package. uPlot is a single package that isn't tree-shakeable (23,292 gzip + 762 CSS). visx heatmap shows the figure that includes React and ReactDOM, 69,985 gzip (chart-only is 1,360).

This table renders 293 ok, 442 unsupported, 0 error, and 0 timeout cells.

The result file counts 294 ok and 442 unsupported, including the /all bundle as one ok cell.

Other full packages, not repeated on each cell: Plotly.js (plotly) 1,477,742 gzip. Tremor (tremor) 246,834 gzip. AG Charts (ag-enterprise) 692,892 gzip. AG Charts (ag-community) 420,736 gzip. TradingView Lightweight Charts (lightweight) 53,352 gzip. Mermaid (mermaid) 962,019 gzip. Vega-Lite (vegalite) 377,693 gzip. AntV G2 (g2) 407,348 gzip.

A package with one native type keeps its gzip on that cell. TradingView Lightweight Charts is that case.

ChartChartKituPlotChart.jsEChartsRechartsNivoObservable PlotHighchartsPlotly.jsVictoryvisxApexChartsTremorVega-LiteAG ChartsamCharts 5Google ChartsTradingView Lightweight ChartsMUI X ChartsMermaidAntV G2
Line32,110not tree-shakeable49,361162,94899,674100,56197,695104,197not tree-shakeable71,69953,343172,332not tree-shakeablenot tree-shakeablenot tree-shakeable93,499unsupportedunsupported151,830unsupportednot tree-shakeable
Bar33,686not tree-shakeable47,523160,99098,76894,37892,903104,197not tree-shakeable67,99552,219180,235not tree-shakeablenot tree-shakeablenot tree-shakeable92,369unsupportedunsupported151,853unsupportednot tree-shakeable
Pie15,293unsupported46,948122,13493,44679,888unsupported104,196not tree-shakeable64,086unsupported169,473unsupportednot tree-shakeablenot tree-shakeable81,711unsupportedunsupported141,038unsupportednot tree-shakeable
Donut15,292unsupported46,913122,13493,44679,888unsupported104,204not tree-shakeable64,086unsupported169,473not tree-shakeablenot tree-shakeablenot tree-shakeable81,711unsupportedunsupported141,038unsupportednot tree-shakeable
Stacked area33,423unsupported51,300162,948100,33781,72699,768104,219not tree-shakeable78,48355,307172,333not tree-shakeablenot tree-shakeablenot tree-shakeable93,499unsupportedunsupportedunsupportedunsupportednot tree-shakeable
Scatter25,987not tree-shakeable45,500156,710100,37699,05891,023104,204not tree-shakeable62,62851,507172,333not tree-shakeablenot tree-shakeablenot tree-shakeableunsupportedunsupportedunsupported147,198unsupportednot tree-shakeable
Combo38,220unsupported52,810171,002106,632unsupportedunsupported104,203not tree-shakeableunsupportedunsupportedunsupportedunsupportednot tree-shakeablenot tree-shakeable96,504unsupportedunsupportedunsupportedunsupportedunsupported
Heatmap13,924unsupportedunsupported166,204unsupported87,89090,839111,289not tree-shakeableunsupported69,985164,503unsupportednot tree-shakeablenot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeable
Gauge7,199unsupportedunsupported116,881unsupportedunsupportedunsupported137,052not tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupported85,491unsupportednot tree-shakeable
KPI9,098unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Sparkline32,112unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupportednot tree-shakeableunsupportedunsupportedunsupported147,452unsupportedunsupported
Mini area32,114not tree-shakeable51,300162,94893,18381,72699,755104,209not tree-shakeable72,29654,216172,333not tree-shakeablenot tree-shakeablenot tree-shakeable93,499unsupportedunsupportedunsupportedunsupportednot tree-shakeable
Progress ring6,673unsupportedunsupportedunsupportedunsupportedunsupportedunsupported138,543unsupportedunsupportedunsupported173,660not tree-shakeableunsupportednot tree-shakeableunsupportedunsupportedunsupported85,491unsupportedunsupported
Spike18,763unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Candlestick18,104unsupportedunsupported164,336unsupportedunsupportedunsupported142,216not tree-shakeableunsupportedunsupported180,131unsupportedunsupportednot tree-shakeable93,112unsupported53,352unsupportedunsupportedunsupported
Histogram17,808unsupportedunsupportedunsupportedunsupportedunsupported95,945105,694not tree-shakeable68,328unsupported184,074unsupportednot tree-shakeablenot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeable
Box plot17,786unsupportedunsupported161,684unsupported89,25795,965137,063not tree-shakeable64,024unsupported180,131unsupportednot tree-shakeablenot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeable
Radar7,945unsupported48,357135,79790,04876,493unsupported137,064not tree-shakeableunsupportedunsupported164,603unsupportedunsupportednot tree-shakeable96,400unsupportedunsupported141,203unsupportedunsupported
Funnel9,489unsupportedunsupported117,58289,96176,890unsupported106,230not tree-shakeableunsupportedunsupportedunsupportednot tree-shakeableunsupportedunsupported79,334unsupportedunsupportedunsupportedunsupportedunsupported
Treemap15,197unsupportedunsupported127,36282,81278,642unsupported113,781not tree-shakeableunsupportedunsupported174,438unsupportedunsupportednot tree-shakeable81,545unsupportedunsupportedunsupportedunsupportednot tree-shakeable
Sankey9,646unsupportedunsupported127,38681,51176,064unsupported110,060not tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeable84,406unsupportedunsupportedunsupportedunsupportednot tree-shakeable
Bullet8,814unsupportedunsupportedunsupportedunsupported76,533unsupported105,006unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Waterfall17,446unsupportedunsupportedunsupportedunsupportedunsupportedunsupported137,056not tree-shakeableunsupportedunsupported181,690unsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Range area19,410not tree-shakeable51,300unsupportedunsupportedunsupported100,090137,061unsupportedunsupportedunsupported172,332unsupportednot tree-shakeablenot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Range bar17,292not tree-shakeable47,523unsupported98,768unsupported92,920137,060unsupportedunsupportedunsupported180,238unsupportednot tree-shakeablenot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Error bar17,558unsupportedunsupportedunsupported101,541unsupportedunsupported137,065not tree-shakeable63,367unsupportedunsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Gantt9,621unsupportedunsupportedunsupportedunsupportedunsupportedunsupported146,351unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported139,554unsupportedunsupportedunsupportednot tree-shakeableunsupported
Timeline8,505unsupportedunsupportedunsupportedunsupportedunsupportedunsupported108,757unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupported
Quadrant8,257unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupported
Venn10,246unsupportedunsupportedunsupportedunsupportedunsupportedunsupported109,093unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported93,971unsupportedunsupportedunsupportednot tree-shakeableunsupported
Journey8,124unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupported
Radial bar10,177unsupportedunsupported159,36890,94582,851unsupported137,064not tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeable96,560unsupportedunsupportedunsupportedunsupportedunsupported
Rose10,177unsupported46,150122,134unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported169,473unsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Sunburst12,397unsupportedunsupported117,77276,90276,520unsupported118,291not tree-shakeableunsupportedunsupported167,284unsupportedunsupportednot tree-shakeable85,450unsupportedunsupportedunsupportedunsupportedunsupported
Bar list7,941unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportednot tree-shakeableunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported

Browser render

ChartKit’s initial render is faster than uPlot in all 12 cells. Even 1,000,000 points is 23.6 ms vs 26.5 ms. Lines above 1,000 points are sampled to the plot width, so the 1,000,000-point cells are not a million drawn points. The aligned update is faster in 6 of 12 and slower in 6. The slower cells are even 1k (1.5 vs 1.2), even 10k (1.9 vs 1.7), jittered 1k (1.6 vs 1.4), gapped 1k (1.6 vs 1.4), gapped 10k (1.9 vs 1.6), gapped 100k (3.5 vs 3.4).

Even x. ChartKit wins the initial (11.3 vs 12.0). The aligned update is a loss: 1.5 vs 1.2. Jittered initial is 10.1 vs 14.2, and that update is also a loss (1.6 vs 1.4). Gapped timestamps: initial 11.8 vs 12.3, update loss 1.6 vs 1.4.

Even x, sampling auto. Initial 14.1 vs 16.3. Aligned update 2.3 vs 2.9, a win. The gapped-timestamp update at this size is a loss: 3.5 vs 3.4.

Even x, sampling auto, so not a million drawn points. Initial 23.6 vs 26.5. Aligned update 10.7 vs 11.2. Jittered 1M is 24.4 vs 32.1 initial and 11.7 vs 13.0 update. Gapped 1M is 27.3 vs 29.1 initial and 11.5 vs 11.8 update.

X spacingPointsChartKit initialuPlot initialChartKit updateuPlot updateCall
Even1,00011.312.01.51.2Win initial. Update loss.
Even10,00013.214.81.91.7Win initial. Update loss.
Even100,00014.116.32.32.9Win initial. Win update.
Even1,000,00023.626.510.711.2Win initial. Win update.
Jittered1,00010.114.21.61.4Win initial. Update loss.
Jittered10,00012.615.21.92.2Win initial. Win update.
Jittered100,00015.019.42.73.4Win initial. Win update.
Jittered1,000,00024.432.111.713.0Win initial. Win update.
Gapped timestamps1,00011.812.31.61.4Win initial. Update loss.
Gapped timestamps10,00012.514.51.91.6Win initial. Update loss.
Gapped timestamps100,00015.017.83.53.4Win initial. Update loss, 3.5 vs 3.4.
Gapped timestamps1,000,00027.329.111.511.8Win initial. Win update.

These 12 cells publish ChartKit and uPlot only. Chart.js, Observable Plot, ECharts, Recharts, and Nivo do not have a millisecond in this table.

Canvas line

Measured 2026-10-21, median of 5, Playwright Chromium, 640×360, sampling auto. This is not a re-time of round 13. Sampling none was not re-timed.

PointsSVG renderCanvas renderSVG firstCanvas firstuPlot firstSVG updateCanvas updateuPlot update
10,0007.37.813.121.814.525.619.133.2
100,0008.29.113.120.117.629.018.123.0
1,000,00016.517.120.827.725.120.621.820.9

Canvas loses first paint at every size: 10,000 is 21.8 ms against SVG 13.1 and uPlot 14.5; 100,000 is 20.1 ms against SVG 13.1 and uPlot 17.6; 1,000,000 is 27.7 ms against SVG 20.8 and uPlot 25.1.

Hover

First hover on a fresh 100,000 point line is a loss to uPlot. ChartKit paints it in 2.1 to 2.2 ms and uPlot in 1.0 to 1.2 ms, painted median, so uPlot is 1.8 to 2.1 times faster. The handler alone is 1.4 to 1.6 ms against 0.3 ms. Steady hover is level: both libraries paint a steady move in about a millisecond or less. ChartKit’s painted median is 0.5 ms and uPlot’s is 0.8 ms in the run below, and 0.4 ms and 0.5 ms in the other run. uPlot’s handler is shorter, 0.1 ms against 0.3 ms. uPlot draws a cursor, a hover point and its legend, and has no tooltip. ChartKit also fills and places a tooltip.

First hoverChartKit painted msChartKit p95ChartKit handleruPlot painted msuPlot p95uPlot handler
50 ms after mount2.12.61.41.01.10.3
200 ms after mount2.24.31.61.22.40.3
Steady hoverHandler msPainted median msPainted p95 ms
ChartKit0.30.50.8
uPlot0.10.81.6

Measured 2026-11-17 on a97fdc5c with bench/browser/hover.mjs: Playwright Chromium, a 640×360 line of 100,000 points, frame-rate limit off, 15 fresh pages per library, Playwright's real mouse. Handler is from the first pointer event of a move to the end of the bubbling mousemove. Painted is to a task after the next animation frame. Raster and GPU time are in neither. Each fresh page gives one first hover and 30 steady moves 16 ms apart, and the two libraries alternate page by page. Cells are the median, with the p95 beside it. There are two runs: one waits 200 ms after mount before the first move (bench/results/hover.json), the other 50 ms (bench/results/hover-50ms.json). uPlot is 1.6.32 with default options: cursor lines, a hover point and its live legend, checked in the page. uPlot has no tooltip, so it places none. ChartKit fills and places a tooltip on every move. One machine. The numbers move with the machine and from run to run, so compare the two columns, not a column against another page.

Downsampling

The fast large-series times use sampling.mark.sampling defaults to auto, which minmax-downsamples a line once it is longer than twice the plot width. 1,000 points stay complete. 10k, 100k, and 1M do not. With sampling off, ChartKit draws every point:
Points, sampling noneInitial msUpdate ms
100,00054.839.2
1,000,000471.8462.4

These sampling-none times use the same fair update timer. At 1,000,000 points that is 471.8 ms to draw and 462.4 ms to update, on that same timer.

Server render

Median milliseconds. Node string or SVG, median of 5. Measured 2026-10-29, commit 71f3fe4. Line is 100,000 points. Candlestick is listed at both measured sizes. A number is an ok cell. unsupported is always labeled and is not a win. error means the run threw. timeout means the sample exceeded 90s. Recharts 3 SSR returns no SVG (except sunburst), and Tremor is affected for the same reason. G2 has no Node SVG path. visx XYChart SSR renders an empty frame. Google Charts isn't an npm package. Commercial libraries were run without license keys.

This table renders 136 ok, 616 unsupported, 1 error, and 3 timeout cells.

The result file counts 136 ok, 616 unsupported, and 4 error. Timeouts are stored as error in that file and labeled timeout here.

Victory stacked-area at 100,000 points timed out at 90s. ApexCharts stacked-area at 100,000 points timed out at 90s. MUI X Charts sparkline at 100,000 points threw. ApexCharts area-range at 100,000 points timed out at 90s.

ChartPointsChartKituPlotChart.jsEChartsRechartsNivoObservable PlotHighchartsPlotly.jsVictoryvisxApexChartsTremorVega-LiteAG ChartsamCharts 5Google ChartsTradingView Lightweight ChartsMUI X ChartsMermaidAntV G2
Line100,0002.63unsupportedunsupported125.4unsupported9,971.5189.17unsupportedunsupported479.96unsupported2,421.3unsupported372.65unsupportedunsupportedunsupportedunsupported1,153.95unsupportedunsupported
Bar480.26unsupportedunsupported5.45unsupported25.732.26unsupportedunsupported5.28unsupported10.58unsupported8.47unsupportedunsupportedunsupportedunsupported10.09unsupportedunsupported
Pie80.03unsupportedunsupported2.94unsupported5.49unsupportedunsupportedunsupported2.67unsupported2.41unsupported6.47unsupportedunsupportedunsupportedunsupported6.19unsupportedunsupported
Donut80.03unsupportedunsupported2.5unsupported4.5unsupportedunsupportedunsupported1.83unsupported1.73unsupported6.34unsupportedunsupportedunsupportedunsupported5.85unsupportedunsupported
Stacked area100,00017.35unsupportedunsupported1,068.79unsupported14,671.36782.92unsupportedunsupportedtimeoutunsupportedtimeoutunsupported2,742.24unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Scatter100,00083.58unsupportedunsupported1,193.52unsupportedunsupported622.45unsupportedunsupported2,758.82unsupported3,771.29unsupported1,069.55unsupportedunsupportedunsupportedunsupported1,281.97unsupportedunsupported
Combo480.3unsupportedunsupported13.85unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported10.52unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Heatmap1,2004.34unsupportedunsupported22.38unsupported111.6614.51unsupportedunsupportedunsupported16.0655.18unsupported13.44unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Gauge10.07unsupportedunsupported2.16unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported1.75unsupportedunsupported
KPI10.04unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported0.3unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Sparkline100,0006.83unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportederrorunsupportedunsupported
Mini area100,0003.28unsupportedunsupported70.73unsupported6,931.8258.37unsupportedunsupported802.6unsupported2,662.91unsupported254.4unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Progress ring10.01unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported1.890.28unsupportedunsupportedunsupportedunsupportedunsupported2.03unsupportedunsupported
Spike100,00024.19unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Candlestick100,000435.69unsupportedunsupported1,354.57unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported7,577.87unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Candlestick2,0005.58unsupportedunsupported35.2unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported87.52unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Histogram100,00010.54unsupportedunsupportedunsupportedunsupportedunsupported29.78unsupportedunsupported72.55unsupported48.33unsupported99.12unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Box plot100,00028.08unsupportedunsupported52.86unsupported53.21196.68unsupportedunsupported613.08unsupported134.79unsupported230.81unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Radar80.08unsupportedunsupported4.16unsupported6.72unsupportedunsupportedunsupportedunsupportedunsupported3unsupportedunsupportedunsupportedunsupportedunsupportedunsupported2.81unsupportedunsupported
Funnel80.05unsupportedunsupported1.88unsupported5.49unsupportedunsupportedunsupportedunsupportedunsupportedunsupported1.05unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Treemap480.78unsupportedunsupported7.8unsupported11.69unsupportedunsupportedunsupportedunsupportedunsupported3.78unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Sankey480.37unsupportedunsupported4.99unsupported11.87unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Bullet60.07unsupportedunsupportedunsupportedunsupported9.07unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Waterfall120.11unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported4.93unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Range area100,0005.21unsupportedunsupportedunsupportedunsupportedunsupported239.71unsupportedunsupportedunsupportedunsupportedtimeoutunsupported462.31unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Range bar240.16unsupportedunsupportedunsupportedunsupportedunsupported1.31unsupportedunsupportedunsupportedunsupported5.57unsupported6.33unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Error bar240.17unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported4.97unsupportedunsupportedunsupported6.75unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Gantt240.27unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Timeline160.09unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Quadrant240.1unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Venn33.06unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Journey120.13unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Radial bar120.12unsupportedunsupported3.53unsupported2.84unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Rose120.06unsupportedunsupported3.19unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported2.63unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Sunburst480.58unsupportedunsupported5.250.973.66unsupportedunsupportedunsupportedunsupportedunsupported5.89unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported
Bar list200.07unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported2.54unsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupportedunsupported

Agent eval

Round 6, recorded in BENCHMARKS.md. Not re-run for round 13. One model, claude-sonnet-4-5, temperature 0, one run on 2026-10-16, 42 tasks. “Official” means the library’s docs were in the prompt. ChartKit’s docs are llms.txt. A supplementary ChartKit-only run the same day, one attempt per task, scored 18/42 with llms.txt in the prompt. That run is not the round 6 scoreboard.

LibraryNo docs, firstNo docs, within twoOfficial, firstOfficial, within twoMean first-try tokens, no docs / official
ChartKit21 / 4242 / 4242 / 4242 / 42139.3 / 132.4
Recharts42 / 4242 / 4242 / 4242 / 42221.9 / 236.5
ECharts42 / 4242 / 4242 / 4242 / 42331.7 / 362.6
Chart.js42 / 4242 / 4242 / 4242 / 42295.0 / 258.4

ChartKit’s first try with no docs is 21 / 42. repair(), with no model call, takes that output to 42/42. With the official docs, ChartKit’s first try is 42 / 42. Mean first-try output tokens with the docs: ChartKit 132.4, Recharts 236.5, ECharts 362.6, Chart.js 258.4. The other libraries have no repair step. The llms.txt this site serves is 6,399 bytes. How to use the loop. The nine-model token medians are a separate test. Review test details and methodology →