Access via REST
Alluxio provides an access interface based on the Restful API for secondary development in Python, Java and Golang. AlluxioRuntime also provides support for this, and the feature is not turned on by default. It can be turned on via a CRD declaration.
Runningâ
- Create Dataset and AlluxioRuntime resource objects
$ cat<<EOF >dataset.yaml
apiVersion: data.fluid.io/v1alpha1
kind: Dataset
metadata:
name: spark
spec:
mounts:
- mountPoint: https://mirrors.bit.edu.cn/apache/spark/
name: spark
---
apiVersion: data.fluid.io/v1alpha1
kind: AlluxioRuntime
metadata:
name: spark
spec:
replicas: 1
tieredstore:
levels:
- mediumtype: MEM
path: /dev/shm
quota: 1Gi
high: "0.95"
low: "0.7"
properties:
alluxio.user.streaming.data.timeout: 300sec
apiGateway:
enabled: true
EOF
Note: Just set apiGateway to true to enable this capability.
- Check Access Endpoint
$ kubectl get alluxioruntimes.data.fluid.io -owide
NAME READY MASTERS DESIRED MASTERS MASTER PHASE READY WORKERS DESIRED WORKERS WORKER PHASE READY FUSES DESIRED FUSES FUSE PHASE API GATEWAY AGE
spark 1 1 Ready 1 1 Ready 0 0 Ready spark-master-0.default:20009 110s
You can see that the API Gateway is accessed at spark-master-0.default:20009. You can access it from this address.