Skip to content

Instantly share code, notes, and snippets.

@databento-bot

databento-bot/x2522.20240813.log

Last active October 1, 2024 14:08
Show Gist options
  • Save databento-bot/9c3feeb38df23f62b21789c243b86072 to your computer and use it in GitHub Desktop.
Save databento-bot/9c3feeb38df23f62b21789c243b86072 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. databento-bot revised this gist Aug 22, 2024. 1 changed file with 12 additions and 8 deletions.
    20 changes: 12 additions & 8 deletions x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -1,13 +1,15 @@
    # One-way, overall
    #
    # 256 byte packets, 0.973/1.093/3.042us (0/50/99p)
    # 0.973/1.093/3.042us (0/50/99p, 256 byte packets)


    # Port-to-port (switch hop)
    #
    # 680+/-20ns
    #
    # Mellanox Spectrum SN2700 w/ Cumulus 5.7
    # 200 byte packets, 1 Gbps packet rate
    # - Mellanox Spectrum SN2700 w/ Cumulus 5.7
    # - 200 byte packets
    # - 1 Gbps packet rate
    #
    #
    $ ./nt_latency -t 2 -r 3 -x 1000 -s 200 -l 5
    @@ -19,12 +21,14 @@ Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s

    # One-way, including switch hop
    #
    # 256 byte packets, 1.653/1.773/3.722us (0/50/99)
    # 1.653/1.773/3.722us (0/50/99, 256 byte packets)
    #
    # AMD Xilinx XtremeScale X2522-25G-PLUS25 GbE w/ OpenOnload 8.0.0.34
    # 256 byte packets, host -> switch -> host
    # disable FEC, tasket/cpuset, etc.
    # see https://www.reddit.com/r/highfreqtrading/comments/1eyrhso/lowlatency_tuning_guide/
    # - AMD EPYC 7543P
    # - AMD Xilinx XtremeScale X2522-25G-PLUS25 GbE
    # - OpenOnload 8.0.0.34
    # - host -> switch -> host
    # - disable FEC, tasket/cpuset, interrupt steering, etc.
    # - see https://www.reddit.com/r/highfreqtrading/comments/1eyrhso/lowlatency_tuning_guide/
    #
    #
    size mean min median max %ile stddev iter
  2. databento-bot revised this gist Aug 22, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -7,7 +7,7 @@
    # 680+/-20ns
    #
    # Mellanox Spectrum SN2700 w/ Cumulus 5.7
    # 1 Gbps packet rate, 200 byte packets
    # 200 byte packets, 1 Gbps packet rate
    #
    #
    $ ./nt_latency -t 2 -r 3 -x 1000 -s 200 -l 5
  3. databento-bot revised this gist Aug 22, 2024. 1 changed file with 10 additions and 4 deletions.
    14 changes: 10 additions & 4 deletions x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -1,9 +1,14 @@
    # Port-to-port
    # One-way, overall
    #
    # 256 byte packets, 0.973/1.093/3.042us (0/50/99p)

    # Port-to-port (switch hop)
    #
    # 680+/-20ns
    #
    # Mellanox Spectrum SN2700 w/ Cumulus 5.7
    # 1 Gbps packet rate, 200 byte packets
    #
    # 680+/-20ns
    #
    $ ./nt_latency -t 2 -r 3 -x 1000 -s 200 -l 5
    Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    @@ -12,14 +17,15 @@ Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    6. 2820408 0 694 712 698 698 1 701


    # One-way including switch hop
    # One-way, including switch hop
    #
    # 256 byte packets, 1.653/1.773/3.722us (0/50/99)
    #
    # AMD Xilinx XtremeScale X2522-25G-PLUS25 GbE w/ OpenOnload 8.0.0.34
    # 256 byte packets, host -> switch -> host
    # disable FEC, tasket/cpuset, etc.
    # see https://www.reddit.com/r/highfreqtrading/comments/1eyrhso/lowlatency_tuning_guide/
    #
    # 256 byte packets, 1.653/1.773/3.722us (0/50/99)
    #
    size mean min median max %ile stddev iter
    0 1613 1487 1603 13821 1853 69 923000
  4. databento-bot revised this gist Aug 22, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -19,7 +19,7 @@ Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    # disable FEC, tasket/cpuset, etc.
    # see https://www.reddit.com/r/highfreqtrading/comments/1eyrhso/lowlatency_tuning_guide/
    #
    # 1.653/1.773/3.722us (0/50/99)
    # 256 byte packets, 1.653/1.773/3.722us (0/50/99)
    #
    size mean min median max %ile stddev iter
    0 1613 1487 1603 13821 1853 69 923000
  5. databento-bot revised this gist Aug 22, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -19,7 +19,7 @@ Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    # disable FEC, tasket/cpuset, etc.
    # see https://www.reddit.com/r/highfreqtrading/comments/1eyrhso/lowlatency_tuning_guide/
    #
    # 1.653/1.773/2.003us (0/50/99)
    # 1.653/1.773/3.722us (0/50/99)
    #
    size mean min median max %ile stddev iter
    0 1613 1487 1603 13821 1853 69 923000
  6. databento-bot revised this gist Aug 22, 2024. 1 changed file with 2 additions and 1 deletion.
    3 changes: 2 additions & 1 deletion x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -16,7 +16,8 @@ Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    #
    # AMD Xilinx XtremeScale X2522-25G-PLUS25 GbE w/ OpenOnload 8.0.0.34
    # 256 byte packets, host -> switch -> host
    # disable FEC, tasket/cpuset, see https://www.reddit.com/r/highfreqtrading/comments/1cqif5t/comment/l3vskn4
    # disable FEC, tasket/cpuset, etc.
    # see https://www.reddit.com/r/highfreqtrading/comments/1eyrhso/lowlatency_tuning_guide/
    #
    # 1.653/1.773/2.003us (0/50/99)
    #
  7. databento-bot revised this gist Aug 14, 2024. 1 changed file with 1 addition and 0 deletions.
    1 change: 1 addition & 0 deletions x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -16,6 +16,7 @@ Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    #
    # AMD Xilinx XtremeScale X2522-25G-PLUS25 GbE w/ OpenOnload 8.0.0.34
    # 256 byte packets, host -> switch -> host
    # disable FEC, tasket/cpuset, see https://www.reddit.com/r/highfreqtrading/comments/1cqif5t/comment/l3vskn4
    #
    # 1.653/1.773/2.003us (0/50/99)
    #
  8. databento-bot revised this gist Aug 14, 2024. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -1,6 +1,6 @@
    # Port-to-port
    #
    # Mellanox Spectrum SN2700
    # Mellanox Spectrum SN2700 w/ Cumulus 5.7
    # 1 Gbps packet rate, 200 byte packets
    #
    # 680+/-20ns
  9. databento-bot revised this gist Aug 14, 2024. 1 changed file with 9 additions and 3 deletions.
    12 changes: 9 additions & 3 deletions x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -1,5 +1,8 @@
    # Port-to-port
    # 1 Gbps, 200 byte packets
    #
    # Mellanox Spectrum SN2700
    # 1 Gbps packet rate, 200 byte packets
    #
    # 680+/-20ns
    #
    $ ./nt_latency -t 2 -r 3 -x 1000 -s 200 -l 5
    @@ -9,8 +12,11 @@ Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    6. 2820408 0 694 712 698 698 1 701


    # One-way host -> switch -> host
    # 256 byte packets
    # One-way including switch hop
    #
    # AMD Xilinx XtremeScale X2522-25G-PLUS25 GbE w/ OpenOnload 8.0.0.34
    # 256 byte packets, host -> switch -> host
    #
    # 1.653/1.773/2.003us (0/50/99)
    #
    size mean min median max %ile stddev iter
  10. databento-bot created this gist Aug 14, 2024.
    35 changes: 35 additions & 0 deletions x2522.20240813.log
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,35 @@
    # Port-to-port
    # 1 Gbps, 200 byte packets
    # 680+/-20ns
    #
    $ ./nt_latency -t 2 -r 3 -x 1000 -s 200 -l 5
    Rate: 1000Mbps, Packet Size: 200, Tx Port: 2, Rx Port: 3, running time: 5s
    ...
    Count Bad Min Max Avg Mean StdDev Last
    6. 2820408 0 694 712 698 698 1 701


    # One-way host -> switch -> host
    # 256 byte packets
    # 1.653/1.773/2.003us (0/50/99)
    #
    size mean min median max %ile stddev iter
    0 1613 1487 1603 13821 1853 69 923000
    1 1617 1492 1608 9418 1853 65 922000
    2 1616 1497 1603 10630 1853 65 922000
    4 1613 1512 1603 4298 1848 64 924000
    8 1614 1487 1603 11717 1853 67 923000
    16 1613 1507 1603 3977 1853 64 924000
    32 1676 1537 1663 3707 1923 71 883000
    64 1704 1568 1693 13010 1948 74 868000
    128 1777 1643 1768 4052 2008 68 832000
    256 1789 1653 1773 3722 2003 65 826000
    512 2112 1983 2099 11983 2314 67 705000
    1024 2309 2179 2294 4318 2534 74 644000
    1472 2801 2655 2780 3907 3025 67 533000
    1473 9754 9197 9723 24266 10595 252 154000
    2048 9877 9207 9838 14567 10670 258 152000
    4096 11511 10650 11467 15895 12524 325 131000
    8192 16514 15154 16491 20925 17774 488 91000
    16384 25906 24031 25879 40282 27402 598 58000
    32768 40886 38488 40828 46213 43107 785 37000