Skip to content

Instantly share code, notes, and snippets.

@felixarntz

felixarntz/wp-64-beta1-benchmarks.md

Created October 3, 2023 00:13
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save felixarntz/ac1ecebe22f3beda970db07440cfdb08 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save felixarntz/ac1ecebe22f3beda970db07440cfdb08 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. felixarntz created this gist Oct 3, 2023.
    223 changes: 223 additions & 0 deletions wp-64-beta1-benchmarks.md
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,223 @@
    # WP 6.4 Beta 1 Benchmarks

    Compared to WP 6.3.1 via https://github.com/swissspidy/compare-wp-performance, based on running:
    ```
    ./run.sh latest https://wordpress.org/wordpress-6.4-beta1.zip
    ```

    ## Overview

    | Metric | Run 1 Before | Run 1 After | Run 1 Diff % | Run 1 Diff abs. | Run 2 Before | Run 2 After | Run 2 Diff % | Run 2 Diff abs. |
    | :------------: | :----------: | :---------: | :----------: | :-------------: | :----------: | :---------: | :----------: | :-------------- |
    | TT3 p50 LCP | 251.7 ms | 253.1 ms | 0.56% | 1.40 ms | 230.25 ms | 232.65 ms | 1.04% | 2.40 ms |
    | TT3 p50 ST | 127.21 ms | 117.98 ms | -7.26% | -9.23 ms | 115.71 ms | 104.42 ms | -9.76% | -11.29 ms |
    | TT1 p50 LCP | 247.15 ms | 195.15 ms | -21.04% | -52.00 ms | 220.4 ms | 185.15 ms | -15.99% | -35.25 ms |
    | TT1 p50 ST | 90.66 ms | 73.18 ms | -19.28% | -17.48 ms | 80.03 ms | 65.53 ms | -18.12% | -14.50 ms |

    ## Web Vitals (Block Theme)

    ### First run

    | Metric | Before | After | Diff % | Diff abs. |
    | :------------: | :-------: | :-------: | :----: | :-------- |
    | FCP (p10) | 243.93 ms | 246.99 ms | 1.25% | 3.06 ms |
    | FCP (p25) | 250.02 ms | 248.57 ms | -0.58% | -1.45 ms |
    | FCP (p50) | 251.7 ms | 253.1 ms | 0.56% | 1.40 ms |
    | FCP (p75) | 267.95 ms | 267.05 ms | -0.34% | -0.90 ms |
    | FCP (p90) | 275.62 ms | 274.31 ms | -0.48% | -1.31 ms |
    | LCP (p10) | 243.93 ms | 246.99 ms | 1.25% | 3.06 ms |
    | LCP (p25) | 250.02 ms | 248.57 ms | -0.58% | -1.45 ms |
    | LCP (p50) | 251.7 ms | 253.1 ms | 0.56% | 1.40 ms |
    | LCP (p75) | 267.95 ms | 267.05 ms | -0.34% | -0.90 ms |
    | LCP (p90) | 275.62 ms | 274.31 ms | -0.48% | -1.31 ms |
    | TTFB (p10) | 171.12 ms | 164.94 ms | -3.61% | -6.18 ms |
    | TTFB (p25) | 175.92 ms | 166.92 ms | -5.12% | -9.00 ms |
    | TTFB (p50) | 178.85 ms | 170.5 ms | -4.67% | -8.35 ms |
    | TTFB (p75) | 185.48 ms | 175.97 ms | -5.13% | -9.51 ms |
    | TTFB (p90) | 194.78 ms | 183.31 ms | -5.89% | -11.47 ms |
    | LCP-TTFB (p10) | 70.05 ms | 78.46 ms | 12.01% | 8.41 ms |
    | LCP-TTFB (p25) | 71.68 ms | 80.88 ms | 12.83% | 9.20 ms |
    | LCP-TTFB (p50) | 75.1 ms | 83.6 ms | 11.32% | 8.50 ms |
    | LCP-TTFB (p75) | 81.05 ms | 90.65 ms | 11.84% | 9.60 ms |
    | LCP-TTFB (p90) | 86.24 ms | 93.55 ms | 8.48% | 7.31 ms |

    ### Second run

    | Metric | Before | After | Diff % | Diff abs. |
    | :------------: | :-------: | :-------: | :----: | :-------- |
    | FCP (p10) | 218.68 ms | 219.64 ms | 0.44% | 0.96 ms |
    | FCP (p25) | 223.35 ms | 221.3 ms | -0.92% | -2.05 ms |
    | FCP (p50) | 230.25 ms | 232.65 ms | 1.04% | 2.40 ms |
    | FCP (p75) | 234.4 ms | 242.58 ms | 3.49% | 8.18 ms |
    | FCP (p90) | 243.02 ms | 264.2 ms | 8.72% | 21.18 ms |
    | LCP (p10) | 218.68 ms | 219.64 ms | 0.44% | 0.96 ms |
    | LCP (p25) | 223.35 ms | 221.3 ms | -0.92% | -2.05 ms |
    | LCP (p50) | 230.25 ms | 232.65 ms | 1.04% | 2.40 ms |
    | LCP (p75) | 234.4 ms | 242.58 ms | 3.49% | 8.18 ms |
    | LCP (p90) | 243.02 ms | 263.39 ms | 8.38% | 20.37 ms |
    | TTFB (p10) | 148.68 ms | 141.38 ms | -4.91% | -7.30 ms |
    | TTFB (p25) | 149.87 ms | 143.73 ms | -4.10% | -6.14 ms |
    | TTFB (p50) | 154.8 ms | 152.05 ms | -1.78% | -2.75 ms |
    | TTFB (p75) | 161.13 ms | 164.73 ms | 2.23% | 3.60 ms |
    | TTFB (p90) | 168.98 ms | 186.22 ms | 10.20% | 17.24 ms |
    | LCP-TTFB (p10) | 68.4 ms | 74.58 ms | 9.04% | 6.18 ms |
    | LCP-TTFB (p25) | 68.85 ms | 76.25 ms | 10.75% | 7.40 ms |
    | LCP-TTFB (p50) | 71.85 ms | 79.6 ms | 10.79% | 7.75 ms |
    | LCP-TTFB (p75) | 81.52 ms | 83.45 ms | 2.37% | 1.93 ms |
    | LCP-TTFB (p90) | 85.83 ms | 85.26 ms | -0.66% | -0.57 ms |

    ## Server-Timing (Block Theme)

    ### First run

    | Metric | Before | After | Diff % | Diff abs. |
    | :----------------------: | :-------: | :-------: | :-----: | :-------- |
    | Response Time (p10) | 128.46 ms | 118.4 ms | -7.83% | -10.06 ms |
    | Response Time (p25) | 130.11 ms | 120.63 ms | -7.29% | -9.48 ms |
    | Response Time (p50) | 133 ms | 123.54 ms | -7.11% | -9.46 ms |
    | Response Time (p75) | 135.77 ms | 126.63 ms | -6.73% | -9.14 ms |
    | Response Time (p90) | 138.51 ms | 129.08 ms | -6.81% | -9.43 ms |
    | wp-before-template (p10) | 61.81 ms | 54.2 ms | -12.31% | -7.61 ms |
    | wp-before-template (p25) | 62.79 ms | 55.15 ms | -12.17% | -7.64 ms |
    | wp-before-template (p50) | 64.16 ms | 56.85 ms | -11.39% | -7.31 ms |
    | wp-before-template (p75) | 67.46 ms | 58.19 ms | -13.74% | -9.27 ms |
    | wp-before-template (p90) | 70.02 ms | 60.83 ms | -13.12% | -9.19 ms |
    | wp-template (p10) | 58.56 ms | 57.83 ms | -1.25% | -0.73 ms |
    | wp-template (p25) | 60.24 ms | 58.71 ms | -2.54% | -1.53 ms |
    | wp-template (p50) | 62.25 ms | 60.4 ms | -2.97% | -1.85 ms |
    | wp-template (p75) | 64.1 ms | 63.71 ms | -0.61% | -0.39 ms |
    | wp-template (p90) | 66.91 ms | 65.29 ms | -2.42% | -1.62 ms |
    | wp-total (p10) | 122.76 ms | 112.45 ms | -8.40% | -10.31 ms |
    | wp-total (p25) | 124.64 ms | 114.71 ms | -7.97% | -9.93 ms |
    | wp-total (p50) | 127.21 ms | 117.98 ms | -7.26% | -9.23 ms |
    | wp-total (p75) | 130.75 ms | 121.19 ms | -7.31% | -9.56 ms |
    | wp-total (p90) | 133.23 ms | 123.91 ms | -7.00% | -9.32 ms |

    ### Second run

    | Metric | Before | After | Diff % | Diff abs. |
    | :----------------------: | :-------: | :-------: | :-----: | :-------- |
    | Response Time (p10) | 116.51 ms | 106.86 ms | -8.28% | -9.65 ms |
    | Response Time (p25) | 118.29 ms | 108.24 ms | -8.50% | -10.05 ms |
    | Response Time (p50) | 120.92 ms | 109.22 ms | -9.68% | -11.70 ms |
    | Response Time (p75) | 124.75 ms | 112.35 ms | -9.94% | -12.40 ms |
    | Response Time (p90) | 131.72 ms | 114.39 ms | -13.16% | -17.33 ms |
    | wp-before-template (p10) | 55.65 ms | 48.25 ms | -13.30% | -7.40 ms |
    | wp-before-template (p25) | 56.94 ms | 49.19 ms | -13.61% | -7.75 ms |
    | wp-before-template (p50) | 58.43 ms | 50.06 ms | -14.32% | -8.37 ms |
    | wp-before-template (p75) | 60.45 ms | 50.85 ms | -15.88% | -9.60 ms |
    | wp-before-template (p90) | 64.41 ms | 52.87 ms | -17.92% | -11.54 ms |
    | wp-template (p10) | 54.86 ms | 52.68 ms | -3.97% | -2.18 ms |
    | wp-template (p25) | 55.88 ms | 53.44 ms | -4.37% | -2.44 ms |
    | wp-template (p50) | 57.5 ms | 54.6 ms | -5.04% | -2.90 ms |
    | wp-template (p75) | 59.27 ms | 55.86 ms | -5.75% | -3.41 ms |
    | wp-template (p90) | 61.97 ms | 57.6 ms | -7.05% | -4.37 ms |
    | wp-total (p10) | 111.6 ms | 102.07 ms | -8.54% | -9.53 ms |
    | wp-total (p25) | 113.08 ms | 103.36 ms | -8.60% | -9.72 ms |
    | wp-total (p50) | 115.71 ms | 104.42 ms | -9.76% | -11.29 ms |
    | wp-total (p75) | 119.65 ms | 107.02 ms | -10.56% | -12.63 ms |
    | wp-total (p90) | 127.04 ms | 109.5 ms | -13.81% | -17.54 ms |

    ## Web Vitals (Classic Theme)

    ### First run

    | Metric | Before | After | Diff % | Diff abs. |
    | :------------: | :-------: | :-------: | :-----: | :-------- |
    | FCP (p10) | 239.44 ms | 189.84 ms | -20.72% | -49.60 ms |
    | FCP (p25) | 246 ms | 192.63 ms | -21.70% | -53.37 ms |
    | FCP (p50) | 247.15 ms | 195.15 ms | -21.04% | -52.00 ms |
    | FCP (p75) | 253.13 ms | 203.68 ms | -19.54% | -49.45 ms |
    | FCP (p90) | 258.36 ms | 207.07 ms | -19.85% | -51.29 ms |
    | LCP (p10) | 239.44 ms | 189.84 ms | -20.72% | -49.60 ms |
    | LCP (p25) | 246 ms | 192.63 ms | -21.70% | -53.37 ms |
    | LCP (p50) | 247.15 ms | 195.15 ms | -21.04% | -52.00 ms |
    | LCP (p75) | 253.13 ms | 203.68 ms | -19.54% | -49.45 ms |
    | LCP (p90) | 258.36 ms | 207.07 ms | -19.85% | -51.29 ms |
    | TTFB (p10) | 125.72 ms | 105.73 ms | -15.90% | -19.99 ms |
    | TTFB (p25) | 130.03 ms | 108.1 ms | -16.87% | -21.93 ms |
    | TTFB (p50) | 132.45 ms | 111.95 ms | -15.48% | -20.50 ms |
    | TTFB (p75) | 138.18 ms | 115.72 ms | -16.25% | -22.46 ms |
    | TTFB (p90) | 142.95 ms | 118.61 ms | -17.03% | -24.34 ms |
    | LCP-TTFB (p10) | 111.01 ms | 82.88 ms | -25.34% | -28.13 ms |
    | LCP-TTFB (p25) | 112.72 ms | 84.53 ms | -25.01% | -28.19 ms |
    | LCP-TTFB (p50) | 115.3 ms | 85.65 ms | -25.72% | -29.65 ms |
    | LCP-TTFB (p75) | 116.85 ms | 87.15 ms | -25.42% | -29.70 ms |
    | LCP-TTFB (p90) | 121.2 ms | 90.02 ms | -25.73% | -31.18 ms |

    ### Second run

    | Metric | Before | After | Diff % | Diff abs. |
    | :------------: | :-------: | :-------: | :-----: | :-------- |
    | FCP (p10) | 215.15 ms | 174.97 ms | -18.68% | -40.18 ms |
    | FCP (p25) | 217.9 ms | 181.45 ms | -16.73% | -36.45 ms |
    | FCP (p50) | 220.4 ms | 185.15 ms | -15.99% | -35.25 ms |
    | FCP (p75) | 232.87 ms | 188.75 ms | -18.95% | -44.12 ms |
    | FCP (p90) | 236.28 ms | 208.73 ms | -11.66% | -27.55 ms |
    | LCP (p10) | 215.15 ms | 174.97 ms | -18.68% | -40.18 ms |
    | LCP (p25) | 217.9 ms | 181.45 ms | -16.73% | -36.45 ms |
    | LCP (p50) | 220.4 ms | 185.15 ms | -15.99% | -35.25 ms |
    | LCP (p75) | 232.87 ms | 188.75 ms | -18.95% | -44.12 ms |
    | LCP (p90) | 236.28 ms | 208.73 ms | -11.66% | -27.55 ms |
    | TTFB (p10) | 112.11 ms | 96.23 ms | -14.16% | -15.88 ms |
    | TTFB (p25) | 114.1 ms | 99.95 ms | -12.40% | -14.15 ms |
    | TTFB (p50) | 117 ms | 102.8 ms | -12.14% | -14.20 ms |
    | TTFB (p75) | 120.2 ms | 105.9 ms | -11.90% | -14.30 ms |
    | TTFB (p90) | 124.14 ms | 115.94 ms | -6.61% | -8.20 ms |
    | LCP-TTFB (p10) | 100.77 ms | 78.3 ms | -22.30% | -22.47 ms |
    | LCP-TTFB (p25) | 102.48 ms | 79.17 ms | -22.75% | -23.31 ms |
    | LCP-TTFB (p50) | 103.9 ms | 83.05 ms | -20.07% | -20.85 ms |
    | LCP-TTFB (p75) | 112.82 ms | 83.92 ms | -25.62% | -28.90 ms |
    | LCP-TTFB (p90) | 114.75 ms | 90.07 ms | -21.51% | -24.68 ms |

    ## Server-Timing (Classic Theme)

    ### First run

    | Metric | Before | After | Diff % | Diff abs. |
    | :----------------------: | :-------: | :------: | :-----: | :-------- |
    | Response Time (p10) | 91.46 ms | 73.35 ms | -19.80% | -18.11 ms |
    | Response Time (p25) | 93.68 ms | 74.98 ms | -19.96% | -18.70 ms |
    | Response Time (p50) | 96.28 ms | 78.27 ms | -18.71% | -18.01 ms |
    | Response Time (p75) | 97.72 ms | 81.05 ms | -17.06% | -16.67 ms |
    | Response Time (p90) | 100.76 ms | 83.26 ms | -17.37% | -17.50 ms |
    | wp-before-template (p10) | 37.68 ms | 34.75 ms | -7.78% | -2.93 ms |
    | wp-before-template (p25) | 40.23 ms | 36.99 ms | -8.05% | -3.24 ms |
    | wp-before-template (p50) | 41.69 ms | 38.72 ms | -7.12% | -2.97 ms |
    | wp-before-template (p75) | 42.98 ms | 40.12 ms | -6.65% | -2.86 ms |
    | wp-before-template (p90) | 44.73 ms | 41.03 ms | -8.27% | -3.70 ms |
    | wp-template (p10) | 47 ms | 30.77 ms | -34.53% | -16.23 ms |
    | wp-template (p25) | 47.97 ms | 32.41 ms | -32.44% | -15.56 ms |
    | wp-template (p50) | 48.57 ms | 35.39 ms | -27.14% | -13.18 ms |
    | wp-template (p75) | 49.59 ms | 36.46 ms | -26.48% | -13.13 ms |
    | wp-template (p90) | 50.8 ms | 37.64 ms | -25.91% | -13.16 ms |
    | wp-total (p10) | 85.28 ms | 68.58 ms | -19.58% | -16.70 ms |
    | wp-total (p25) | 88.38 ms | 70.04 ms | -20.75% | -18.34 ms |
    | wp-total (p50) | 90.66 ms | 73.18 ms | -19.28% | -17.48 ms |
    | wp-total (p75) | 92.18 ms | 75.96 ms | -17.60% | -16.22 ms |
    | wp-total (p90) | 95.25 ms | 77.89 ms | -18.23% | -17.36 ms |

    ### Second run

    | Metric | Before | After | Diff % | Diff abs. |
    | :----------------------: | :------: | :------: | :-----: | :-------- |
    | Response Time (p10) | 82.38 ms | 68.39 ms | -16.98% | -13.99 ms |
    | Response Time (p25) | 83.89 ms | 69.5 ms | -17.15% | -14.39 ms |
    | Response Time (p50) | 85.66 ms | 70.8 ms | -17.35% | -14.86 ms |
    | Response Time (p75) | 87.53 ms | 72.44 ms | -17.24% | -15.09 ms |
    | Response Time (p90) | 89.48 ms | 74.79 ms | -16.42% | -14.69 ms |
    | wp-before-template (p10) | 34.81 ms | 33.13 ms | -4.83% | -1.68 ms |
    | wp-before-template (p25) | 35.87 ms | 33.82 ms | -5.72% | -2.05 ms |
    | wp-before-template (p50) | 36.76 ms | 34.62 ms | -5.82% | -2.14 ms |
    | wp-before-template (p75) | 37.47 ms | 35.68 ms | -4.78% | -1.79 ms |
    | wp-before-template (p90) | 39.18 ms | 36.73 ms | -6.25% | -2.45 ms |
    | wp-template (p10) | 42.1 ms | 29.88 ms | -29.03% | -12.22 ms |
    | wp-template (p25) | 42.64 ms | 30.37 ms | -28.78% | -12.27 ms |
    | wp-template (p50) | 43.2 ms | 30.85 ms | -28.59% | -12.35 ms |
    | wp-template (p75) | 44.22 ms | 31.53 ms | -28.70% | -12.69 ms |
    | wp-template (p90) | 45.41 ms | 32.36 ms | -28.74% | -13.05 ms |
    | wp-total (p10) | 77.51 ms | 63.71 ms | -17.80% | -13.80 ms |
    | wp-total (p25) | 78.53 ms | 64.51 ms | -17.85% | -14.02 ms |
    | wp-total (p50) | 80.03 ms | 65.53 ms | -18.12% | -14.50 ms |
    | wp-total (p75) | 81.6 ms | 67.21 ms | -17.63% | -14.39 ms |
    | wp-total (p90) | 83.76 ms | 69.11 ms | -17.49% | -14.65 ms |