Skip to content

Instantly share code, notes, and snippets.

@anjannath
Created August 1, 2022 13:16
Show Gist options
  • Save anjannath/ad0b005ca740dff2a0cb8cda3d378cd6 to your computer and use it in GitHub Desktop.
Save anjannath/ad0b005ca740dff2a0cb8cda3d378cd6 to your computer and use it in GitHub Desktop.

Revisions

  1. anjannath created this gist Aug 1, 2022.
    131 changes: 131 additions & 0 deletions 9p-qemu_vs_virtiofs-vfkit
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,131 @@
    # podman 4.1.1 from brew with 9p
    [core@localhost ~]$ uname -r -s -v
    Linux 5.18.13-200.fc36.aarch64 #1 SMP PREEMPT_DYNAMIC Fri Jul 22 13:44:25 UTC 2022
    [core@localhost ~]$ fio --name=random-readers --filename=testfile --ioengine=libaio --iodepth=16 --rw=randrw --bs=512 --direct=0 --size=1G --numjobs=1 --runtime=60s --group_reporting --fallocate=none --time_based --thread --invalidate=1
    random-readers: (g=0): rw=randrw, bs=(R) 512B-512B, (W) 512B-512B, (T) 512B-512B, ioengine=libaio, iodepth=16
    fio-3.29
    Starting 1 thread
    Jobs: 1 (f=1): [m(1)][100.0%][r=24.6MiB/s,w=24.8MiB/s][r=50.4k,w=50.7k IOPS][eta 00m:00s]
    random-readers: (groupid=0, jobs=1): err= 0: pid=1395: Mon Aug 1 17:33:47 2022
    read: IOPS=35.0k, BW=17.1MiB/s (17.9MB/s)(1026MiB/60001msec)
    slat (nsec): min=496, max=6568.2k, avg=12831.07, stdev=43917.65
    clat (usec): min=20, max=431487, avg=214.80, stdev=1241.37
    lat (usec): min=20, max=431489, avg=227.76, stdev=1246.96
    clat percentiles (usec):
    | 1.00th=[ 29], 5.00th=[ 32], 10.00th=[ 34], 20.00th=[ 35],
    | 30.00th=[ 37], 40.00th=[ 39], 50.00th=[ 42], 60.00th=[ 94],
    | 70.00th=[ 165], 80.00th=[ 330], 90.00th=[ 635], 95.00th=[ 881],
    | 99.00th=[ 1532], 99.50th=[ 1827], 99.90th=[ 3163], 99.95th=[ 3785],
    | 99.99th=[ 4948]
    bw ( KiB/s): min= 2811, max=82930, per=100.00%, avg=17606.17, stdev=19662.86, samples=119
    iops : min= 5622, max=165860, avg=35212.56, stdev=39325.88, samples=119
    write: IOPS=35.0k, BW=17.1MiB/s (17.9MB/s)(1025MiB/60001msec); 0 zone resets
    slat (nsec): min=631, max=3599.8k, avg=13251.93, stdev=43694.29
    clat (nsec): min=1489, max=431266k, avg=214193.71, stdev=1107516.36
    lat (usec): min=20, max=431267, avg=227.57, stdev=1113.78
    clat percentiles (usec):
    | 1.00th=[ 29], 5.00th=[ 32], 10.00th=[ 34], 20.00th=[ 35],
    | 30.00th=[ 37], 40.00th=[ 39], 50.00th=[ 42], 60.00th=[ 94],
    | 70.00th=[ 165], 80.00th=[ 330], 90.00th=[ 635], 95.00th=[ 881],
    | 99.00th=[ 1532], 99.50th=[ 1827], 99.90th=[ 3097], 99.95th=[ 3687],
    | 99.99th=[ 4948]
    bw ( KiB/s): min= 2908, max=82720, per=100.00%, avg=17587.37, stdev=19627.87, samples=119
    iops : min= 5816, max=165441, avg=35174.98, stdev=39255.84, samples=119
    lat (usec) : 2=0.01%, 20=0.01%, 50=54.22%, 100=7.16%, 250=14.25%
    lat (usec) : 500=10.23%, 750=6.93%, 1000=3.75%
    lat (msec) : 2=3.14%, 4=0.29%, 10=0.03%, 500=0.01%
    cpu : usr=6.06%, sys=18.74%, ctx=840664, majf=0, minf=1
    IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
    submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued rwts: total=2101061,2098730,0,0 short=0,0,0,0 dropped=0,0,0,0
    latency : target=0, window=0, percentile=100.00%, depth=16

    Run status group 0 (all jobs):
    READ: bw=17.1MiB/s (17.9MB/s), 17.1MiB/s-17.1MiB/s (17.9MB/s-17.9MB/s), io=1026MiB (1076MB), run=60001-60001msec
    WRITE: bw=17.1MiB/s (17.9MB/s), 17.1MiB/s-17.1MiB/s (17.9MB/s-17.9MB/s), io=1025MiB (1075MB), run=60001-60001msec

    Disk stats (read/write):
    vda: ios=528397/1163661, merge=0/4, ticks=42101/639877, in_queue=682914, util=99.60%


    -----------------------------------------------------------------------------------------------------------------
    # vfkit with virtiofs with podman preset on crc

    [core@podman ~]$ time cp /Users/anjan/Downloads/AlmaLinux-9.0-beta-1-aarch64-minimal.iso /home/core/

    real 0m1.354s
    user 0m0.001s
    sys 0m0.943s

    # podman from brew with qemu and 9p
    [core@localhost ~]$ time cp /home/anjan/Downloads/AlmaLinux-9.0-beta-1-aarch64-minimal.iso ~/

    real 0m2.517s
    user 0m0.000s
    sys 0m0.807s

    # full logs
    $ podman machine init -v /Users/anjan:/home/anjan
    Extracting compressed file
    Image resized.
    Machine init complete
    To start your machine run:

    podman machine start


    anjan at anath-mac in ~
    $ podman machine start
    Starting machine "podman-machine-default"
    Waiting for VM ...
    Mounting volume... /Users/anjan:/home/anjan
    bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)

    This machine is currently configured in rootless mode. If your containers
    require root permissions (e.g. ports < 1024), or if you run into compatibility
    issues with non-podman clients, you can switch using the following command:

    podman machine set --rootful

    API forwarding listening on: /Users/anjan/.local/share/containers/podman/machine/podman-machine-default/podman.sock

    The system helper service is not installed; the default Docker API socket
    address can't be used by podman. If you would like to install it run the
    following commands:

    sudo /opt/homebrew/Cellar/podman/4.1.1/bin/podman-mac-helper install
    podman machine stop; podman machine start

    You can still connect Docker API clients by setting DOCKER_HOST using the
    following command in your terminal session:

    export DOCKER_HOST='unix:///Users/anjan/.local/share/containers/podman/machine/podman-machine-default/podman.sock'

    Machine "podman-machine-default" started successfully

    anjan at anath-mac in ~
    $ podman machine ssh
    Connecting to vm podman-machine-default. To close connection, use `~.` or `exit`
    Warning: Permanently added '[localhost]:59388' (ED25519) to the list of known hosts.
    Fedora CoreOS 36.20220723.2.2
    Tracker: https://github.com/coreos/fedora-coreos-tracker
    Discuss: https://discussion.fedoraproject.org/tag/coreos

    -bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    /usr/bin/sh: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
    [core@localhost ~]$ time cp /home/anjan/Downloads/AlmaLinux-9.0-beta-1-aarch64-minimal.iso ~/

    real 0m2.517s
    user 0m0.000s
    sys 0m0.807s
    [core@localhost ~]$