Cloudera Data Services On Premises 1.5.5 SP4 Release
Updated:
Cloudera Data Services 1.5.5 SP4 is now Generally Available, enhancing business continuity and accelerating AI capabilities across the platform. This release introduces full disaster recovery for Embedded Container Service clusters, native NVIDIA HGX/DGX and Multi-Instance GPU support, and a 100% reduction in known exploited vulnerabilities. Customers on SP2 or later can upgrade directly to SP4 without intermediate steps, ensuring a smoother transition to the latest features.
Release Highlights
- Full disaster recovery across the entire stack: Backup and restore for Embedded Container Service clusters now cover Data Engineering and Data Warehouse workloads, including scheduled, ad-hoc, and incremental backups with guided restoration to a secondary cluster.
- Enterprise GPU support for AI workloads: Support for NVIDIA HGX/DGX infrastructure with RDMA and GPUDirect, Multi-Instance GPU (MIG) for partitioning A100/H100 GPUs, and distributed training scaling to 32+ GPUs.
- Zero known exploited vulnerabilities: A 100% reduction from SP3, achieved through Chainguard-based images and Ubuntu 24.x upgrades, significantly shrinking the CVE footprint for security-conscious buyers.
- Skip-version upgrades: Customers on SP2 can upgrade directly to SP4 without installing SP3, reducing downtime, risk, and change windows via multi-hop Longhorn upgrades.
- Unified observability with OpenTelemetry: Telemetry export across AI, Data Engineering, and Data Warehouse to customer-managed endpoints, enabling integration with tools like Datadog, Splunk, and Grafana.
- Embedded database HA: Automatic failover for the platform database eliminates the single-point-of-failure.
- Non-root container images: Support for arbitrary user IDs without custom images simplifies security compliance.
- Networking updates: Includes Istio 1.30 and Kubernetes Gateway API 1.5.
- Cloudera AI Inference: LoRA adapter support for serving multiple fine-tuned models from one endpoint, persistent model storage, and vLLM 0.27 with broader model coverage.
- Cloudera AI Workbench: MIG and HGX/DGX support, multi-node distributed training (32+ GPUs, Ray/PyTorch/MPI, 400G RDMA).
- Cloudera AI Registry: Async model downloads with job tracking and progress UI.
- Cloudera AI ML Runtimes: R 4.6, Python 3.14 RAZ support, Ubuntu 24.x base, and Chainguard images for lower CVE footprint.
- Data Engineering Auto config sync: LDAP/proxy changes from Cloudera Manager propagate automatically to Cloudera Data Engineering.
- Data Engineering Istio Ambient Mode: Sidecar-free service mesh providing less overhead with the same security.
- Data Engineering Observability Premium: Workload consumption metrics and OpenTelemetry export of Spark event logs.
- Data Engineering Data Connectors: Support for HBase, Kafka, and Phoenix with simplified credential management for Spark.
- Data Engineering Stable endpoints on upgrade: In-place upgrades from SP3+ ensure no broken integrations.
- Data Warehouse Disaster recovery: Full disaster recovery including Virtual Warehouses, Data Visualization, and Data Explorer (Formerly known as Hue).
- Data Warehouse Config change alerts: Kerberos and certificate changes are surfaced in the Management Console.
- Data Warehouse Automatic mTLS: Ambient mode enrollment with STRICT mutual TLS across warehouse services.
- Data Warehouse Centralized telemetry: OpenTelemetry export for Hive and Impala Virtual Warehouses.
- Observability GPU metrics: Now available in the Cloudera AI SaaS observability experience.
- Security Chainguard images: Ubuntu freshline runtimes replaced with lower-CVE-footprint alternatives.
Links
- Release Notes
- Public Documentation for 1.5.5 SP4
- Cloudera Data Services on premises 1.5.5 SP4 Archive
- Supported Upgrades
- Support Matrix
Cloudera Data Services On Premises 1.5.5 SP4 Release
If you would like a deeper dive, hands on experience, demos, or are interested in speaking with me further about Cloudera Data Services On Premises 1.5.5 SP4 Release please reach out to schedule a discussion.