Tom Augspurger TomAugspurger
TomAugspurger
/ q4-spilling.ipynb
Created
November 13, 2025 16:06
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
TomAugspurger
/ packages.diff
Created
November 10, 2025 17:39
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| --- ok.txt 2025-11-10 09:38:59.410995539 -0800 | |
| +++ error.txt 2025-11-10 09:39:15.465981068 -0800 | |
| @@ -20,7 +20,7 @@ | |
| aws-c-sdkutils 0.2.4 h7e655bb_2 conda-forge | |
| aws-checksums 0.2.7 h7e655bb_3 conda-forge | |
| aws-crt-cpp 0.35.0 h719b17a_2 conda-forge | |
| -aws-sdk-cpp 1.11.606 h522d481_5 conda-forge | |
| +aws-sdk-cpp 1.11.606 h522d481_6 conda-forge | |
| aws-xray-sdk 2.15.0 pyhd8ed1ab_0 conda-forge | |
| azure-core-cpp 1.16.1 h3a458e0_0 conda-forge |
TomAugspurger
/ log.txt
Created
November 7, 2025 21:24
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (cudf-polars-bench) root@gpu-h100-0161:/app# for query in {1..22}; do | |
| > nsys profile \ | |
| > -o "/data/profiles/rapidsmpf.q$query.1k" -f true \ | |
| > --trace=nvtx,cuda \ | |
| > --nvtx-domain-exclude=CCCL,rapidsmpf,libkvikio \ | |
| > --cuda-memory-usage=true \ | |
| > python -m cudf_polars.experimental.benchmarks.pdsh \ | |
| > --executor="streaming" \ | |
| > --runtime="rapidsmpf" \ | |
| > --path="/data/tpch-rs/scale-1000" \ |
TomAugspurger
/ page.html
Created
November 7, 2025 20:05
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!DOCTYPE html> | |
| <html lang="en"> | |
| <head> | |
| <meta charset="UTF-8"> | |
| <meta name="viewport" content="width=device-width, initial-scale=1.0"> | |
| <title>Benchmark Results Explorer</title> | |
| <link href="https://unpkg.com/[email protected]/dist/css/tabulator.min.css" rel="stylesheet"> | |
| <style> | |
| body { | |
| font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Oxygen, Ubuntu, Cantarell, sans-serif; |
TomAugspurger
/ log.txt
Created
November 7, 2025 17:59
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| root@gpu-h100-0261:/app# export TERM=linux | |
| root@gpu-h100-0261:/app# unset UCX_NET_DEVICES | |
| root@gpu-h100-0261:/app# export UCX_PROTO_ENABLE="y" | |
| root@gpu-h100-0261:/app# export UCX_RNDV_PIPELINE_ERROR_HANDLING="y" | |
| root@gpu-h100-0261:/app# export UCX_MAX_RNDV_RAILS="1" | |
| root@gpu-h100-0261:/app# export DASK_DISTRIBUTED__COMM__TIMEOUTS__CONNECT="300" | |
| root@gpu-h100-0261:/app# export DASK_DISTRIBUTED__COMM__UCX__CONNECT_TIMEOUT="300" | |
| root@gpu-h100-0261:/app# | |
| root@gpu-h100-0261:/app# . /app/.venv/bin/activate | |
| (cudf-polars-bench) root@gpu-h100-0261:/app# |
TomAugspurger
/ 2025-11-07.0.txt
Created
November 7, 2025 13:13
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (cudf-polars-bench) root@gpu-h100-0468:/app# for query in {1..22}; do | |
| > python -m cudf_polars.experimental.benchmarks.pdsh \ | |
| > --executor="streaming" \ | |
| > --runtime="rapidsmpf" \ | |
| > --path="/data/tpch-rs/scale-1000" \ | |
| > --suffix="" \ | |
| > --stream-policy="pool" \ | |
| > --n-workers 1 \ | |
| > --no-print-results \ | |
| > --no-summarize \ |
TomAugspurger
/ debug.cpp
Created
October 27, 2025 17:59
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // ----------------------------------------------------------------------------- | |
| // Reproducer (translated from Python) | |
| // ----------------------------------------------------------------------------- | |
| #include <cudf/column/column.hpp> | |
| #include <cudf/column/column_factories.hpp> | |
| #include <cudf/strings/contains.hpp> | |
| #include <cudf/strings/regex/regex_program.hpp> | |
| #include <cudf/strings/strings_column_view.hpp> | |
| #include <cudf/types.hpp> |
TomAugspurger
/ debug.cpp
Created
October 27, 2025 17:54
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // ----------------------------------------------------------------------------- | |
| // Reproducer (translated from Python) | |
| // ----------------------------------------------------------------------------- | |
| #include <cudf/column/column.hpp> | |
| #include <cudf/column/column_factories.hpp> | |
| #include <cudf/strings/contains.hpp> | |
| #include <cudf/strings/regex/regex_program.hpp> | |
| #include <cudf/strings/strings_column_view.hpp> | |
| #include <cudf/types.hpp> |
TomAugspurger
/ cuda-stream-violation.py
Last active
October 16, 2025 15:21
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python3 | |
| """ | |
| Stream-ordering race using CuPy with RMM's async memory resource. | |
| This should trigger compute-sanitizer's stream-ordered race detection. | |
| """ | |
| import cupy as cp | |
| import rmm.mr | |
| from rmm.allocators.cupy import rmm_cupy_allocator |
TomAugspurger
/ viz_traces.py
Last active
October 7, 2025 20:58
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python3 | |
| """ | |
| Convert cudf-polars traces from JSONL format to Chrome Tracing format. | |
| Chrome Tracing format can be viewed in chrome://tracing or similar tools. | |
| """ | |
| import json | |
| import sys | |
| from pathlib import Path |
NewerOlder