Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save thaihust/ae893cadde9e560737262cf41fb9a496 to your computer and use it in GitHub Desktop.
Save thaihust/ae893cadde9e560737262cf41fb9a496 to your computer and use it in GitHub Desktop.

Revisions

  1. @ajarr ajarr revised this gist Aug 2, 2017. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion dev_setup_cephfs_nfs_manila.md
    Original file line number Diff line number Diff line change
    @@ -17,7 +17,7 @@ $ cd devstack
    * Create a local.conf

    ```
    cat <<EOF >foo.txt
    cat <<EOF >local.conf
    [[local|localrc]]
    HOST_IP=10.0.2.15
    DATABASE_PASSWORD=rengen
  2. @ajarr ajarr revised this gist Jun 27, 2017. 1 changed file with 2 additions and 2 deletions.
    4 changes: 2 additions & 2 deletions dev_setup_cephfs_nfs_manila.md
    Original file line number Diff line number Diff line change
    @@ -56,8 +56,8 @@ enable_service q-dhcp
    enable_service q-l3
    enable_service q-meta
    enable_plugin manila https://github.com/ajarr/manila bp/cephfs-nfs-support
    enable_plugin devstack-plugin-ceph https://github.com/ajarr/devstack-plugin-ceph cephfs-ganesha
    enable_plugin manila git://git.openstack.org/openstack/manila
    enable_plugin devstack-plugin-ceph git://git.openstack.org/openstack/devstack-plugin-ceph
    ENABLE_CEPH_CINDER=False
    ENABLE_CEPH_GLANCE=False
  3. @ajarr ajarr revised this gist Jun 24, 2017. 1 changed file with 52 additions and 2 deletions.
    54 changes: 52 additions & 2 deletions dev_setup_cephfs_nfs_manila.md
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,4 @@
    ## Dev testing manila's cephfs(NFS) driver
    # Dev testing manila's cephfs(NFS) driver

    Reference https://docs.openstack.org/developer/manila/devref/cephfs_driver.html

    @@ -55,7 +55,7 @@ enable_service q-agt
    enable_service q-dhcp
    enable_service q-l3
    enable_service q-meta
    enable_plugin manila https://github.com/ajarr/manila bp/cephfs-nfs-support
    enable_plugin devstack-plugin-ceph https://github.com/ajarr/devstack-plugin-ceph cephfs-ganesha
    @@ -80,4 +80,54 @@ $./stack.sh
    $ ps aux | grep manila
    $ sudo ceph -s
    $ systemctl status nfs-ganesha
    ```

    * Set the ganesha server's IP address (the nova guest VM should be able to connect to this address)
    in the cephfsnfs1 driver section of manila.conf using the `cephfs_ganesha_server_ip' option.
    Now restart the manila share service.

    ```
    [cephfsnfs1]
    cephfs_ganesha_server_ip = 172.24.4.3
    share_driver = manila.share.drivers.cephfs.driver.CephFSDriver
    share_backend_name = CEPHFSNFS1
    driver_handles_share_servers = False
    cephfs_protocol_helper_type = NFS
    cephfs_conf_path = /etc/ceph/ceph.conf
    cephfs_auth_id = manila
    ```

    * Configure a share type that matches the CephFS/NFS-Ganesha backend capabilities.

    ```
    manila type-create cephfsnfstype false
    manila type-key cephfsnfstype set vendor_name=Ceph storage_protocol=NFS
    ```

    * Create a share.

    ```
    manila create --share-type cephfsnfstype --name cephnfsshare1 nfs 1
    ```

    * Note the export location of the share:

    ```
    manila share-export-location-list cephnfsshare1
    ```
    The export location of the share contains the IP address of the NFS-Ganesha
    server and the path to be mounted. It is of the form,
    ``{NFS-Ganesha server address}:{path to be mounted}``


    * Allow access to a nova VM, which can connect to the ganesha server.

    ```
    manila access-allow cephnfsshare1 ip 172.24.4.225
    ```

    * Try mounting the NFS share from the VM, IP 172.24.4.225

    ```
    sudo mount -t nfs 172.24.4.3:/volumes/_nogroup/6732900b-32c1-4816-a529-4d6d3f15811e /mnt/nfs/
    ```
  4. @ajarr ajarr revised this gist Jun 23, 2017. 1 changed file with 19 additions and 5 deletions.
    24 changes: 19 additions & 5 deletions dev_setup_cephfs_nfs_manila.md
    Original file line number Diff line number Diff line change
    @@ -1,14 +1,20 @@
    Creating all-in-one CephFS/Ganesha/Mania setup using devstack
    in a CentOS7 VM.
    ## Dev testing manila's cephfs(NFS) driver

    Clone devstack
    Reference https://docs.openstack.org/developer/manila/devref/cephfs_driver.html

    Create all-in-one** CephFS/Ganesha/Manila setup using devstack in a CentOS7 machine similar to the one in the upstream gate, _gate-manila-tempest-minimal-dsvm-cephfs-nfs-centos-7-nv_

    ** Ceph server daemons (1 OSD, 1 MON, 1 MDS), NFS-Ganesha server,
    and manila-services all run in the same machine.

    * Clone devstack

    ```
    $ git clone https://github.com/openstack-dev/devstack
    $ cd devstack
    ```

    Create a local.conf
    * Create a local.conf

    ```
    cat <<EOF >foo.txt
    @@ -62,8 +68,16 @@ MANILA_CEPH_DRIVER=cephfsnfs
    EOF
    ```

    Run devstack
    * Run devstack

    ```
    $./stack.sh
    ```

    * If stack run is successful, then manila-services, Ceph servers, and NFS-Ganesha server should be up and running.

    ```
    $ ps aux | grep manila
    $ sudo ceph -s
    $ systemctl status nfs-ganesha
    ```
  5. @ajarr ajarr renamed this gist Jun 23, 2017. 1 changed file with 0 additions and 0 deletions.
  6. @ajarr ajarr revised this gist Jun 23, 2017. 1 changed file with 7 additions and 0 deletions.
    7 changes: 7 additions & 0 deletions cephfs-nfs-ganesha manila driver setup for devs
    Original file line number Diff line number Diff line change
    @@ -2,11 +2,14 @@ Creating all-in-one CephFS/Ganesha/Mania setup using devstack
    in a CentOS7 VM.

    Clone devstack

    ```
    $ git clone https://github.com/openstack-dev/devstack
    $ cd devstack
    ```

    Create a local.conf

    ```
    cat <<EOF >foo.txt
    [[local|localrc]]
    @@ -60,3 +63,7 @@ EOF
    ```

    Run devstack

    ```
    $./stack.sh
    ```
  7. @ajarr ajarr created this gist Jun 23, 2017.
    62 changes: 62 additions & 0 deletions cephfs-nfs-ganesha manila driver setup for devs
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,62 @@
    Creating all-in-one CephFS/Ganesha/Mania setup using devstack
    in a CentOS7 VM.

    Clone devstack
    ```
    $ git clone https://github.com/openstack-dev/devstack
    $ cd devstack
    ```
    Create a local.conf
    ```
    cat <<EOF >foo.txt
    [[local|localrc]]
    HOST_IP=10.0.2.15
    DATABASE_PASSWORD=rengen
    RABBIT_PASSWORD=guest
    SERVICE_TOKEN=rengen
    SERVICE_PASSWORD=rengen
    ADMIN_PASSWORD=rengen


    INSTALL_TESTONLY_PACKAGES=yes
    INSTALL_TEMPEST=True

    # Enable logging
    LOGFILE=/opt/stack/logs/stack.sh.log
    VERBOSE=True
    LOG_COLOR=True
    SCREEN_LOGDIR=/opt/stack/logs
    LOGDAYS=2

    RECLONE=no

    disable_service horizon

    disable_service heat
    disable_service h-eng
    disable_service h-api
    disable_service h-api-cfn
    disable_service h-api-cw

    disable_service n-net

    enable_service neutron
    enable_service q-svc
    enable_service q-agt
    enable_service q-dhcp
    enable_service q-l3
    enable_service q-meta

    enable_plugin manila https://github.com/ajarr/manila bp/cephfs-nfs-support
    enable_plugin devstack-plugin-ceph https://github.com/ajarr/devstack-plugin-ceph cephfs-ganesha

    ENABLE_CEPH_CINDER=False
    ENABLE_CEPH_GLANCE=False
    ENABLE_CEPH_C_BAK=False
    ENABLE_CEPH_NOVA=False
    ENABLE_CEPH_MANILA=True
    MANILA_CEPH_DRIVER=cephfsnfs
    EOF
    ```

    Run devstack