What the Firebolt Operator enforces
The Firebolt Operator stamps a hardened security posture on the workloads it renders. How much you can change that posture depends on the CRD surface. Engine pods expose a wide pod-template merge layer throughFireboltEngineClass and FireboltEngine. Gateway and metadata primary
containers keep operator-owned hardening and only let you set image and
resources on the primary container.
Per-field allowlists for each template surface live in
api/v1alpha1/operatorauthority.go (PodTemplateRules per component)
and in the CRD reference pages linked in each subsection below.
Engine
When neither a referencedFireboltEngineClass nor the engine’s own
spec.template sets a container securityContext, the Firebolt Operator
applies these defaults on the engine container:
| Field | Default |
|---|---|
| UID / GID | 3473 / 3473 |
runAsNonRoot | true |
| Capabilities | drop ALL |
allowPrivilegeEscalation | false |
| Read-only root filesystem | true (unix domain socket via emptyDir at /var/run/firebolt; status file and engine data on the PVC at /firebolt-core/volume) |
| Seccomp | not set |
securityContext wholesale through
FireboltEngineClass.spec.template or
FireboltEngine.spec.template.spec.containers[name=="engine"].securityContext.
The engine template wins over the class. There is no merge or floor. A
template value replaces the operator default completely, including the
ability to weaken hardening.
Pod-level spec.template.spec.securityContext is also user-settable. The
Firebolt Operator only stamps fsGroup (3473) and
fsGroupChangePolicy: OnRootMismatch when you leave those fields unset.
Sidecar containers and init containers pass through from your template
without operator hardening.
Validating webhooks on FireboltEngine and FireboltEngineClass (and
the engine reconciler when webhooks are off) reject operator-owned paths
on engine templates: command, args, ports, probes, reserved env keys, and
firebolt.io/* labels. They do not reject a weakened securityContext.
See the FireboltEngineClass CRD reference
and FireboltEngine CRD reference.
Gateway (Envoy)
The Envoy primary container is operator-rendered end to end. The validating webhook rejects user input on itssecurityContext. You may
only set image and resources on
spec.gateway.template.spec.containers[name=="envoy"]. The Firebolt
Operator stamps:
| Field | Value |
|---|---|
| UID | 101 |
runAsNonRoot | true |
| Capabilities | drop ALL |
allowPrivilegeEscalation | false |
| Read-only root filesystem | true (scratch via emptyDir at /tmp) |
| Seccomp | not set on the container |
spec.gateway.template (node selector, tolerations,
securityContext, sidecars, init containers) pass through when allowed
by the template rules. See the
FireboltInstance CRD reference.
Metadata (Pensieve)
The metadata primary container follows the same pattern as the gateway. Operator-stamped hardening applies tocontainers[name=="metadata"].
You may set only image and resources there:
| Field | Value |
|---|---|
| UID | 1111 (pinned to the image’s dedicated-pensieve user) |
runAsNonRoot | true |
| Capabilities | drop ALL |
allowPrivilegeEscalation | false |
| Read-only root filesystem | true (scratch via emptyDir at /tmp) |
| Seccomp | not set on the container |
PodSecurityContext to runAsNonRoot: true with UID/GID 1111 and sets
seccompProfile: RuntimeDefault when you do not supply one. A template
cannot run the metadata pod under a different user without failing image
ownership checks.
PostgreSQL (internal)
Internal PostgreSQL has no user template surface. The Firebolt Operator stamps hardening on every reconcile:| Level | Posture |
|---|---|
| Pod | UID/GID 70, runAsNonRoot: true, seccompProfile: RuntimeDefault |
| Container | UID 70, runAsNonRoot: true, drop ALL capabilities, allowPrivilegeEscalation: false, read-only root filesystem (PGDATA on the PVC, runtime sockets on emptyDir) |
config/rbac/role.yaml) is the minimal set of verbs
needed to manage the three CRDs and their generated resources. The
Firebolt Operator does not request * on any namespaced verb and
does not request nodes, clusterrolebindings, or any other
cluster-scope mutation.
The chart renders the manager rules in one of two shapes, picked at
install time by watchNamespaces:
- Empty list (default): one cluster-scoped
ClusterRoleand oneClusterRoleBinding. The manager cache spans every namespace. - Non-empty list, e.g.
{tenant-a, tenant-b}: aRoleplusRoleBindingpair in each listed namespace, noClusterRole. The manager cache spans only those namespaces. Use this posture when multi-tenant compliance constraints bound the operator’s blast radius.
FireboltInstance.spec.metricScrapeMode=PodIP reaches
engine metrics through pod IPs and does not need pods/proxy: get,
so the chart’s manager RBAC does not include that verb. Setting
metricScrapeMode=ApiserverProxy on any FireboltInstance requires
rbac.apiserverProxyGrant=true on the operator chart, which
renders a dedicated ClusterRole (or per-namespace Role when
watchNamespaces is set) granting only that one verb. Without the
toggle, the metric scrape surfaces as a 403 from the apiserver.
Resource maxima on the engine container’s resources block (set
under FireboltEngine.spec.template.spec.containers[name=="engine"]
or inherited from a referenced FireboltEngineClass) are enforced by
the validating webhook (see “Resource bounds” below). The bounds
protect a namespace from accidentally admitting an engine whose
requests would starve sibling workloads at scheduling time.
What the Firebolt Operator does not enforce
Network isolation between pods
The Firebolt Operator emits no NetworkPolicy objects. All pod-to-pod and pod-to-external traffic is governed by whatever the cluster’s CNI and NetworkPolicy controller already enforce. In a default Kubernetes install with no NetworkPolicy controller installed, every pod can reach every other pod on every port. This is a deliberate scoping decision: NetworkPolicy semantics depend on the CNI plugin (Calico, Cilium, Antrea, etc.), the cluster’s default-allow-vs-default-deny posture, and the Firebolt Operator-vs-platform ownership boundary for security primitives. Encoding any of those assumptions into Firebolt Operator-emitted NetworkPolicies would either be a no-op (no controller installed) or actively wrong for the deployment target. Platform teams should apply NetworkPolicies covering at least the allowed flows below. Recommended selectors:| Pod kind | Selector |
|---|---|
| Engine pods | firebolt.io/engine exists (matches any generation of any engine in the namespace) |
| Gateway / Metadata / PostgreSQL | firebolt.io/component={gateway,metadata,postgres} |
| Instance scoping | firebolt.io/instance=<instance-name> (present on instance-level workloads only. Engines carry firebolt.io/engine instead, which is unique per engine) |
Allowed flows
| From | To | Port | Purpose |
|---|---|---|---|
| External clients | Gateway | 8080 | Query traffic (HTTP) |
| Gateway | Engine pods | 3473 | Query forwarding |
| Engine pods | Metadata | 7000 | Metadata gRPC |
| Metadata | PostgreSQL | 5432 | Metadata catalog reads/writes |
| Engine pods | External object store | 443 / 80 | Managed-storage reads/writes (S3, GCS, etc.) |
| Prometheus | Engine / Gateway / Operator | 9090 / 9090 / 8443 | Metrics scraping |
| kube-apiserver | Operator webhook | 9443 | Admission control |
Example baseline NetworkPolicy
The snippet below denies all ingress and egress by default in the instance’s namespace, then re-allows the flows above. It assumes the gateway’s external clients live in afirebolt-clients namespace. The
selector should be adjusted to match the actual client topology.
Namespace-level resource ceilings
AResourceQuota capping the aggregate of requests.cpu /
requests.memory / pod count / PVC size across all engines in a
namespace is a platform concern. The Firebolt Operator enforces per-engine
upper bounds in admission (see below) but does not emit a
ResourceQuota. The per-namespace budget is a deployment-target
decision (test cluster vs. multi-tenant production).
Image provenance and supply-chain attestation
The Firebolt Operator pulls whatever image the user supplies viaFireboltEngine.spec.template.spec.containers[engine].image, the
referenced FireboltEngineClass.spec.template.spec.containers[engine].image,
or the embedded defaults shipped with the Firebolt Operator binary
(merged in that order, top wins). The Firebolt Operator does not
validate signatures, attestations, or SBOMs. Use a cluster-level
admission controller (Kyverno, Sigstore Policy Controller, etc.) if
image-policy enforcement is required.
Resource bounds
The FireboltEngine validating webhook rejects engine-containerresources entries above Firebolt Operator-configured maxima. The
gate resolves the effective container the same way the reconciler
will: the engine’s own
spec.template.spec.containers[name=="engine"].resources wins
wholesale when set, otherwise the referenced FireboltEngineClass’s
container resources fill in. Both sources are checked, so a class
with oversized requests cannot escape admission by being referenced
from an engine that omits its own resources. The error message names
the source class when the offending value came from class so the
user knows which side to edit.
This is a defense-in-depth control against accidental
over-provisioning. A typoed 100Gi instead of 10Gi is caught at
admission rather than at scheduling time when it would silently
exhaust namespace capacity and block other engines.
The maxima are configurable at Firebolt Operator install time. Defaults are
sized for typical production deployments. Override via Helm values
when running larger or smaller engines.
Secrets handling
The Firebolt Operator generates one Secret: the internal PostgreSQL credentials (<instance>-metadata-postgres-creds). The password is
generated at first reconcile, persisted to a Kubernetes Secret with
owner reference to the FireboltInstance, and never re-rotated by the
Firebolt Operator. The metadata and PostgreSQL Deployments load it via
envFrom.
User-supplied credentials (external PostgreSQL, external object
store) are referenced by name on the FireboltInstance / FireboltEngine
spec and resolved at reconcile time. The Firebolt Operator never reads or
materializes a user-supplied secret’s value into its own status,
events, or logs.
See also
- architecture: Full Firebolt Operator architecture.
- monitoring: Metrics and alerts the Firebolt Operator exposes.
- instance-crd-reference: Firebolt Operator-owned vs. user-owned fields on FireboltInstance.
- fireboltengineclass-crd-reference: Firebolt Operator-owned vs. user-owned fields on FireboltEngineClass.