Installing CSI Driver for PowerScale via Operator
The CSI Driver for Dell PowerScale can be installed via the Dell CSI Operator.
To deploy the Operator, follow the instructions available here.
There are sample manifests provided which can be edited to do an easy installation of the driver. Note that the deployment of the driver using the operator does not use any Helm charts and the installation and configuration parameters will be slightly different from the one specified via the Helm installer.
Kubernetes Operators make it easy to deploy and manage the entire lifecycle of complex Kubernetes applications. Operators use Custom Resource Definitions (CRD) which represents the application and use custom controllers to manage them.
Note: MKE (Mirantis Kubernetes Engine) does not support the installation of CSI-PowerScale via Operator.
Listing installed drivers with the CSI Isilon CRD
User can query for CSI-PowerScale driver using the following command:
kubectl get csiisilon --all-namespaces
kubectl create namespace test-isilonto create the test-isilon namespace (if not already present). Note that the namespace can be any user-defined name, in this example, we assume that the namespace is ’test-isilon'.
Create isilon-creds secret by using secret.yaml file format only.
2.1 Create a yaml file called secret.yaml with the following content:
isilonClusters: # logical name of PowerScale Cluster - clusterName: "cluster1" # username for connecting to PowerScale OneFS API server # Default value: None username: "user" # password for connecting to PowerScale OneFS API server password: "password" # HTTPS endpoint of the PowerScale OneFS API server # Default value: None # Examples: "18.104.22.168", "https://22.214.171.124", "https://abc.myonefs.com" endpoint: "126.96.36.199" # Is this a default cluster (would be used by storage classes without ClusterName parameter) # Allowed values: # true: mark this cluster config as default # false: mark this cluster config as not default # Default value: false isDefault: true # Specify whether the PowerScale OneFS API server's certificate chain and host name should be verified. # Allowed values: # true: skip OneFS API server's certificate verification # false: verify OneFS API server's certificates # Default value: default value specified in values.yaml # skipCertificateValidation: true # The base path for the volumes to be created on PowerScale cluster # This will be used if a storage class does not have the IsiPath parameter specified. # Ensure that this path exists on PowerScale cluster. # Allowed values: unix absolute path # Default value: default value specified in values.yaml # Examples: "/ifs/data/csi", "/ifs/engineering" # isiPath: "/ifs/data/csi" # The permissions for isi volume directory path # This will be used if a storage class does not have the IsiVolumePathPermissions parameter specified. # Allowed values: valid octal mode number # Default value: "0777" # Examples: "0777", "777", "0755" # isiVolumePathPermissions: "0777" - clusterName: "cluster2" username: "user" password: "password" endpoint: "188.8.131.52" endpointPort: "8080"
Replace the values for the given keys as per your environment. After creating the secret.yaml, the following command can be used to create the secret,
kubectl create secret generic isilon-creds -n isilon --from-file=config=secret.yaml
Use the following command to replace or update the secret
kubectl create secret generic isilon-creds -n isilon --from-file=config=secret.yaml -o yaml --dry-run | kubectl replace -f -
Note: The user needs to validate the YAML syntax and array related key/values while replacing the isilon-creds secret. The driver will continue to use previous values in case of an error found in the YAML file.
Create isilon-certs-n secret. Please refer this section for creating cert-secrets.
If certificate validation is skipped, empty secret must be created. To create an empty secret. Ex: empty-secret.yaml
apiVersion: v1 kind: Secret metadata: name: isilon-certs-0 namespace: isilon type: Opaque data: cert-0: ""
kubectl create -f empty-secret.yaml
Create a CR (Custom Resource) for PowerScale using the sample files provided here.
Users should configure the parameters in CR. The following table lists the primary configurable parameters of the PowerScale driver and their default values:
Parameter Description Required Default dnsPolicy Determines the DNS Policy of the Node service Yes ClusterFirstWithHostNet fsGroupPolicy Defines which FS Group policy mode to be used, Supported modes
None, File and ReadWriteOnceWithFSType
No “ReadWriteOnceWithFSType” X_CSI_MAX_PATH_LIMIT Defines the maximum length of path for a volume No 192 Common parameters for node and controller CSI_ENDPOINT The UNIX socket address for handling gRPC calls No /var/run/csi/csi.sock X_CSI_ISI_SKIP_CERTIFICATE_VALIDATION Specifies whether SSL security needs to be enabled for communication between PowerScale and CSI Driver No true X_CSI_ISI_PATH Base path for the volumes to be created Yes X_CSI_ALLOWED_NETWORKS Custom networks for PowerScale export. List of networks that can be used for NFS I/O traffic, CIDR format should be used No empty X_CSI_ISI_AUTOPROBE To enable auto probing for driver No true X_CSI_ISI_NO_PROBE_ON_START Indicates whether the controller/node should probe during initialization Yes X_CSI_ISI_VOLUME_PATH_PERMISSIONS The permissions for isi volume directory path Yes 0777 X_CSI_ISI_AUTH_TYPE Indicates the authentication method to be used. If set to 1 then it follows as session-based authentication else basic authentication No 0 Controller parameters X_CSI_MODE Driver starting mode No controller X_CSI_ISI_ACCESS_ZONE Name of the access zone a volume can be created in No System X_CSI_ISI_QUOTA_ENABLED To enable SmartQuotas Yes nodeSelector Define node selection constraints for pods of controller deployment No X_CSI_HEALTH_MONITOR_ENABLED Enable/Disable health monitor of CSI volumes from Controller plugin. Provides details of volume status and volume condition. As a prerequisite, external-health-monitor sidecar section should be uncommented in samples which would install the sidecar No false Node parameters X_CSI_MAX_VOLUMES_PER_NODE Specify the default value for the maximum number of volumes that the controller can publish to the node Yes 0 X_CSI_MODE Driver starting mode No node X_CSI_HEALTH_MONITOR_ENABLED Enable/Disable health monitor of CSI volumes from node plugin. Provides details of volume usage No false Side car parameters leader-election-lease-duration Duration, that non-leader candidates will wait to force acquire leadership No 20s leader-election-renew-deadline Duration, that the acting leader will retry refreshing leadership before giving up No 15s leader-election-retry-period Duration, the LeaderElector clients should wait between tries of actions No 5s
Execute the following command to create PowerScale custom resource:
kubectl create -f <input_sample_file.yaml>. This command will deploy the CSI-PowerScale driver in the namespace specified in the input YAML file.
- From CSI-PowerScale v1.6.0 and higher, Storage class and VolumeSnapshotClass will not be created as part of driver deployment. The user has to create Storageclass and Volume Snapshot Class.
- “Kubelet config dir path” is not yet configurable in case of Operator based driver installation.
- Also, snapshotter and resizer sidecars are not optional to choose, it comes default with Driver installation.
Volume Health Monitoring
This feature is introduced in CSI Driver for PowerScale version 2.1.0.
Operator based installation
Volume Health Monitoring feature is optional and by default this feature is disabled for drivers when installed via operator.
To enable this feature, add the below block to the driver manifest before installing the driver. This ensures to install external health monitor sidecar. To get the volume health state
value under controller should be set to true as seen below. To get the volume stats
value under node should be set to true.
# Uncomment the following to install 'external-health-monitor' sidecar to enable health monitor of CSI volumes from Controller plugin. # Also set the env variable controller.envs.X_CSI_HEALTH_MONITOR_ENABLED to "true". # - name: external-health-monitor # args: ["--monitor-interval=60s"] # Install the 'external-health-monitor' sidecar accordingly. # Allowed values: # true: enable checking of health condition of CSI volumes # false: disable checking of health condition of CSI volumes # Default value: false controller: envs: - name: X_CSI_HEALTH_MONITOR_ENABLED value: "true" node: envs: # X_CSI_HEALTH_MONITOR_ENABLED: Enable/Disable health monitor of CSI volumes from node plugin - volume usage # Allowed values: # true: enable checking of health condition of CSI volumes # false: disable checking of health condition of CSI volumes # Default value: false - name: X_CSI_HEALTH_MONITOR_ENABLED value: "true"