Do we support multiple replicas for st2sensorcontainer, st2rulesengine in kubernetes-1ppc mode?

longfei · April 4, 2018, 2:41am

Hi Team,
I deployed st2 using kubernetes-1ppc mode
I saw all the replicas in the st2.yml are all set to 1
like st2sensorcontainer

github.com

StackStorm/st2-docker/blob/master/runtime/kubernetes-1ppc/st2.yml#L128


ports:
- protocol: TCP
  port: 9102


---
apiVersion: apps/v1beta1
kind: Deployment
metadata:
name: st2sensorcontainer
spec:
replicas: 1
template:
  metadata:
    labels:
      app: st2sensorcontainer
  spec:
    containers:
    - name: st2sensorcontainer
      image: stackstorm/stackstorm:latest
      imagePullPolicy: IfNotPresent
      env:

I went through our ha doc and found some st2 comps need to take extra work to achieve HA(like st2rulesengine need to disable the timer, st2sensorcontainer need to consider partitioning sensors)
https://docs.stackstorm.com/reference/ha.html
My question is do we support multi-replicas? expecially for st2sensorcontainer,st2rulesengine, these comps.
Any extra work to do when using kubernetes-1ppc mode?

warrenvw · April 5, 2018, 4:47pm

Sorry… I do not know of any out-of-the-box st2-docker based solution that does the noted extra work required to achieve HA. I believe multi-replicas would work in k8s-1ppc mode once these additional changes are made.

Anyone else able to provide a working example?

longfei · April 18, 2018, 7:44am

I run with following configurations and it worked for me
replicas:
st2web: 3
st2stream: 3
st2sensorcontainer: 1
st2rulesengine: 1
st2resultstracker: 3
st2notifier: 3
st2garbagecollector: 1
st2auth: 3
st2api: 3
st2actionrunner: 3
mistralserver: 3
mistralapi: 3