This is a quick hack to get prometheus to read pmacct flow data. Rather than writing a proper exporter, I used exporter_exporter to spawn a python script for each scrape.
NOTE: each pmacct aggregate will end up as a distinct timeseries, so you need to make sure you don't have a cardinality explosion.
| #!/usr/bin/python3 | |
| """ | |
| Copyright 2025 Brian Candler | |
| Redistribution and use in source and binary forms, with or without | |
| modification, are permitted provided that the following conditions are met: | |
| 1. Redistributions of source code must retain the above copyright notice, | |
| this list of conditions and the following disclaimer. |
If someone asked me the question "what layout should I use for my Go code repository?", I'd start by asking back "what are you building: an executable, or a library?"
Create a directory named however you want your final executable to be called (e.g. "mycommand"), change into that directory, and create the following files:
| """ | |
| Backend for Hashicorp Vault OIDC Identity Provider in Vault 1.9+ | |
| https://www.vaultproject.io/docs/secrets/identity/oidc-provider | |
| """ | |
| import base64 | |
| from social_core.backends.open_id_connect import OpenIdConnectAuth | |
| from social_core.utils import cache | |
| package main | |
| import ( | |
| "fmt" | |
| "net/http" | |
| "os" | |
| "strings" | |
| ) | |
| func redirect(w http.ResponseWriter, req *http.Request) { |
| Sep 21 09:35:24 loki systemd[1]: Starting Vector... | |
| Sep 21 09:35:24 loki vector[24928]: √ Loaded ["/etc/vector/vector.toml"] | |
| Sep 21 09:35:24 loki vector[24928]: √ Component configuration | |
| Sep 21 09:35:24 loki vector[24928]: √ Health check "loki" | |
| Sep 21 09:35:24 loki vector[24928]: ------------------------------------ | |
| Sep 21 09:35:24 loki vector[24928]: Validated | |
| Sep 21 09:35:24 loki systemd[1]: Started Vector. | |
| Sep 21 09:35:24 loki vector[24932]: Sep 21 09:35:24.385 INFO vector::app: Log level is enabled. level="vector=trace,codec=trace,vrl=trace,file_source=trace,tower_limit=trace,rdkafka=trace" enable_datadog_tracing=false | |
| Sep 21 09:35:24 loki vector[24932]: Sep 21 09:35:24.386 INFO vector::app: Loading configs. paths=["/etc/vector/vector.toml"] | |
| Sep 21 09:35:24 loki vector[24932]: Sep 21 09:35:24.417 DEBUG vector::tls::settings: Fetching system root certs. |
| #!/usr/bin/python3 | |
| import os | |
| import shutil | |
| import subprocess | |
| import sys | |
| index = int(sys.argv[1]) | |
| num_disks = int(sys.argv[2]) | |
| base = os.path.abspath("mybase.img") |
| libguestfs: create: flags = 0, handle = 0x55be3d261850, program = guestfish | |
| libguestfs: command: run: qemu-img | |
| libguestfs: command: run: \ create | |
| libguestfs: command: run: \ -f qcow2 | |
| libguestfs: command: run: \ -o backing_file=/home/nsrc/nsrc-gns3/scripts/mybase.img,compat=1.1 | |
| libguestfs: command: run: \ /tmp/gf-run.20461/node0.qcow2 | |
| Formatting '/tmp/gf-run.20461/node0.qcow2', fmt=qcow2 size=1474560 compat=1.1 backing_file=/home/nsrc/nsrc-gns3/scripts/mybase.img cluster_size=65536 lazy_refcounts=off refcount_bits=16 | |
| libguestfs: command: run: qemu-img | |
| libguestfs: command: run: \ create | |
| libguestfs: command: run: \ -f qcow2 |
| #!/usr/bin/python3 | |
| import os | |
| import shutil | |
| import subprocess | |
| import sys | |
| index = int(sys.argv[1]) | |
| num_disks = int(sys.argv[2]) | |
| base = os.path.abspath("mybase.img") |
| #!/usr/bin/python3 | |
| import subprocess, sys | |
| COUNT = 36 | |
| CONCURRENCY = 12 | |
| NUM_DISKS = 46 | |
| jobs = [] | |
| errors = [] |