Skip to content

Instantly share code, notes, and snippets.

@anonrig

anonrig/benchmark-before.md

Created December 19, 2022 18:33
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save anonrig/e624f2b2584b93424b886490c3c0ac02 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save anonrig/e624f2b2584b93424b886490c3c0ac02 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. anonrig created this gist Dec 19, 2022.
    117 changes: 117 additions & 0 deletions benchmark-before.md
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,117 @@
    ```sh
    confidence improvement accuracy (*) (**) (***)
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='iso-8859-3' *** -8.97 % ±1.74% ±2.32% ±3.02%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='latin1' *** -6.81 % ±2.78% ±3.73% ±4.90%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='utf-8' *** -27.20 % ±3.30% ±4.39% ±5.72%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='iso-8859-3' *** -7.95 % ±2.52% ±3.35% ±4.37%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='latin1' *** -8.82 % ±1.84% ±2.45% ±3.18%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='utf-8' *** -25.98 % ±2.69% ±3.58% ±4.66%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='iso-8859-3' *** -8.32 % ±1.94% ±2.59% ±3.37%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='latin1' *** -8.97 % ±3.02% ±4.03% ±5.25%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='utf-8' *** 123.54 % ±5.77% ±7.73% ±10.16%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='iso-8859-3' *** -10.02 % ±2.10% ±2.79% ±3.64%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='latin1' *** -7.71 % ±2.19% ±2.93% ±3.84%
    util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='utf-8' *** 128.42 % ±6.38% ±8.58% ±11.33%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='iso-8859-3' ** 4.17 % ±3.09% ±4.12% ±5.38%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='latin1' * 4.05 % ±3.82% ±5.09% ±6.64%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='utf-8' *** -9.90 % ±3.95% ±5.25% ±6.84%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='iso-8859-3' *** 6.64 % ±3.69% ±4.92% ±6.40%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='latin1' 1.72 % ±4.36% ±5.81% ±7.56%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='utf-8' *** -9.20 % ±4.51% ±6.00% ±7.81%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='iso-8859-3' -0.10 % ±3.57% ±4.75% ±6.19%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='latin1' 3.63 % ±4.40% ±5.85% ±7.62%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='utf-8' *** 133.49 % ±6.67% ±8.90% ±11.65%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='iso-8859-3' 2.66 % ±4.00% ±5.32% ±6.93%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='latin1' * 4.03 % ±3.51% ±4.68% ±6.09%
    util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='utf-8' *** 136.34 % ±5.53% ±7.38% ±9.64%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='iso-8859-3' -0.67 % ±1.20% ±1.60% ±2.09%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='latin1' -0.22 % ±1.31% ±1.75% ±2.27%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='utf-8' ** -5.06 % ±3.50% ±4.68% ±6.13%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='iso-8859-3' -0.16 % ±1.66% ±2.22% ±2.90%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='latin1' 0.18 % ±3.96% ±5.27% ±6.89%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='utf-8' -2.41 % ±2.57% ±3.43% ±4.50%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='iso-8859-3' -0.62 % ±1.60% ±2.13% ±2.78%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='latin1' 0.55 % ±1.38% ±1.83% ±2.38%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='utf-8' *** 277.15 % ±5.08% ±6.82% ±9.00%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='iso-8859-3' -0.62 % ±1.50% ±1.99% ±2.60%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='latin1' 1.06 % ±1.50% ±2.00% ±2.63%
    util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='utf-8' *** 275.12 % ±2.71% ±3.63% ±4.76%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='iso-8859-3' -3.77 % ±4.08% ±5.46% ±7.17%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='latin1' *** -7.26 % ±2.57% ±3.43% ±4.49%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='utf-8' ** -8.12 % ±6.05% ±8.05% ±10.49%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='iso-8859-3' -4.47 % ±5.07% ±6.75% ±8.82%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='latin1' *** -10.11 % ±2.77% ±3.69% ±4.80%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='utf-8' * -7.04 % ±5.59% ±7.44% ±9.68%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='iso-8859-3' *** -25.04 % ±6.10% ±8.15% ±10.69%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='latin1' *** -8.18 % ±2.80% ±3.72% ±4.84%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='utf-8' *** -13.57 % ±2.98% ±3.99% ±5.24%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='iso-8859-3' *** -27.96 % ±4.71% ±6.29% ±8.25%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='latin1' *** -7.46 % ±3.91% ±5.24% ±6.89%
    util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='utf-8' *** -10.00 % ±4.63% ±6.17% ±8.04%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='iso-8859-3' * 3.49 % ±3.15% ±4.19% ±5.45%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='latin1' 3.27 % ±4.31% ±5.74% ±7.48%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='utf-8' * -5.69 % ±5.06% ±6.77% ±8.90%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='iso-8859-3' 1.97 % ±3.46% ±4.60% ±5.99%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='latin1' 0.08 % ±3.62% ±4.82% ±6.28%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='utf-8' -4.49 % ±5.21% ±6.96% ±9.11%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='iso-8859-3' -1.37 % ±3.89% ±5.22% ±6.87%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='latin1' 2.32 % ±4.93% ±6.55% ±8.53%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='utf-8' *** 127.24 % ±9.01% ±12.08% ±15.91%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='iso-8859-3' 2.72 % ±2.90% ±3.87% ±5.03%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='latin1' ** 5.97 % ±3.85% ±5.12% ±6.67%
    util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='utf-8' *** 136.23 % ±5.87% ±7.84% ±10.25%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='iso-8859-3' 0.30 % ±1.64% ±2.18% ±2.86%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='latin1' -0.72 % ±1.27% ±1.69% ±2.20%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='utf-8' ** -2.56 % ±1.75% ±2.33% ±3.03%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='iso-8859-3' -0.74 % ±1.40% ±1.86% ±2.43%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='latin1' -0.28 % ±1.97% ±2.63% ±3.42%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='utf-8' ** -2.21 % ±1.60% ±2.13% ±2.78%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='iso-8859-3' 0.93 % ±4.48% ±6.01% ±7.92%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='latin1' 0.35 % ±1.06% ±1.41% ±1.85%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='utf-8' *** 272.15 % ±5.96% ±8.01% ±10.58%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='iso-8859-3' -1.06 % ±1.62% ±2.16% ±2.81%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='latin1' 0.76 % ±1.49% ±1.99% ±2.61%
    util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='utf-8' *** 269.66 % ±3.20% ±4.31% ±5.70%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='iso-8859-3' *** -6.45 % ±3.19% ±4.25% ±5.55%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='latin1' *** -5.92 % ±2.04% ±2.73% ±3.58%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='utf-8' *** -28.02 % ±3.67% ±4.89% ±6.38%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='iso-8859-3' *** -9.14 % ±2.06% ±2.74% ±3.56%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='latin1' *** -10.71 % ±1.91% ±2.55% ±3.33%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='utf-8' *** -27.77 % ±3.82% ±5.08% ±6.61%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='iso-8859-3' *** -9.36 % ±2.78% ±3.70% ±4.82%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='latin1' *** -7.63 % ±2.48% ±3.30% ±4.30%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='utf-8' *** 121.65 % ±5.95% ±7.97% ±10.49%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='iso-8859-3' *** -9.50 % ±2.53% ±3.36% ±4.38%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='latin1' *** -7.38 % ±2.21% ±2.94% ±3.84%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='utf-8' *** 125.32 % ±6.57% ±8.82% ±11.64%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='iso-8859-3' 3.37 % ±3.91% ±5.20% ±6.77%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='latin1' 2.45 % ±2.93% ±3.90% ±5.07%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='utf-8' *** -8.47 % ±3.18% ±4.23% ±5.51%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='iso-8859-3' 2.27 % ±4.37% ±5.82% ±7.58%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='latin1' 1.14 % ±3.96% ±5.28% ±6.88%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='utf-8' -3.28 % ±5.24% ±7.00% ±9.16%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='iso-8859-3' 3.52 % ±4.02% ±5.36% ±6.98%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='latin1' ** 6.07 % ±3.94% ±5.26% ±6.89%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='utf-8' *** 123.11 % ±8.76% ±11.74% ±15.46%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='iso-8859-3' 4.16 % ±5.25% ±6.99% ±9.12%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='latin1' 2.82 % ±3.55% ±4.73% ±6.16%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='utf-8' *** 128.08 % ±7.38% ±9.91% ±13.07%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='iso-8859-3' -0.26 % ±1.24% ±1.65% ±2.14%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='latin1' 1.31 % ±1.47% ±1.96% ±2.56%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='utf-8' * -3.20 % ±2.81% ±3.74% ±4.87%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='iso-8859-3' -0.61 % ±1.98% ±2.63% ±3.43%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='latin1' -1.50 % ±2.63% ±3.52% ±4.63%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='utf-8' *** -2.24 % ±1.26% ±1.67% ±2.18%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='iso-8859-3' * -1.91 % ±1.73% ±2.31% ±3.02%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='latin1' -0.08 % ±1.14% ±1.51% ±1.97%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='utf-8' *** 265.69 % ±6.12% ±8.25% ±10.93%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='iso-8859-3' -1.32 % ±1.92% ±2.56% ±3.33%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='latin1' 0.75 % ±2.61% ±3.49% ±4.59%
    util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='utf-8' *** 270.53 % ±7.36% ±9.92% ±13.15%

    Be aware that when doing many comparisons the risk of a false-positive result increases.
    In this case, there are 108 comparisons, you can thus expect the following amount of false-positive results:
    5.40 false positives, when considering a 5% risk acceptance (*, **, ***),
    1.08 false positives, when considering a 1% risk acceptance (**, ***),
    0.11 false positives, when considering a 0.1% risk acceptance (***)
    ```