Note: The job is a remote job and is open to candidates in USA. United Software Group Inc is seeking a highly skilled Cloudera Public Cloud Platform Engineer to operate and manage the end-to-end CDP platform ecosystem. This role is responsible for ensuring availability, scalability, security, and performance of all platform services supporting data, analytics, and AI workloads across environments.
Responsibilities
- Own end-to-end operational responsibility for Cloudera Public Cloud services across Dev / Stage / UAT / Prod:CDE, CDW, COD, CDL, CDF (NiFi), CDV, CAI, Kafka
- Ensure multi-cluster stability, workload isolation, and SLA adherence
- Support onboarding and operations of multiple applications across environments
- Manage and support multi-environment, multi-cluster deployments with strict isolation, governance, and release coordination across Dev/UAT/Prod
- Operate and support Cloudera AI (CAI) environments: AI Workbenches, AI Studios
- Model training and development environments
- AI inference endpoints and model serving
- Troubleshoot: Resource contention (CPU/GPU)
- Model deployment/runtime failures
Skills
- 4–6 years of experience in Big Data Platform / Cloud Operations / Infrastructure Support role
- 3+ years of experience with Cloudera ecosystem (CDH/CDP)
- Hands-on experience with: CDP services (CDE, CDW, CDF, CAI)
- Monitoring, alerting, and operational support
- Strong understanding of: Cloud platforms (AWS/Azure/GCP basics – IAM, storage, networking)
- Kubernetes concepts (pod-level troubleshooting, logs, resource usage)
- Experience in: Production support and incident handling (P2/P3)
- Platform monitoring, issue triage, and escalation
- Responsible for: Executing day-to-day platform operations
- Supporting deployments, monitoring, and troubleshooting
- Following runbooks and operational procedures
- Strong experience with Cloudera CDP Public Cloud
- Expertise in: Cloud platforms (AWS/Azure/GCP)
- Kubernetes concepts (troubleshooting-focused)
- Hands-on with: CDE, CDW, CDF (NiFi), CAI
- Knowledge of: IAM, networking, observability tools
- Platforms operating at multi-terabyte to petabyte scale with high concurrency workloads
- Hands-on experience with: Kafka (or similar streaming platforms) including monitoring, troubleshooting, and performance tuning
- Experience with Cloudera CDP CLI (Command Line Interface) for: Platform operations and administration
- Job execution and service management (CDE/CDW/CDL)
- Automation of routine operational tasks
- Strong working knowledge of: Cloud IAM (AWS IAM / Azure AD) including roles, policies, and cross-service access
- User and group mapping across CDP, cloud IAM, and Ranger policies
- Troubleshooting access issues across storage (S3/ADLS), CDP services, and data access layers
- Experience with: Modernization of legacy data platforms/applications to Cloudera CDP Public Cloud
- Migration and onboarding of workloads to CDE, CDW, and CAI environments
- Supporting hybrid or multi-environment transitions (on-prem → cloud)
- Familiarity with: Cloud platforms (AWS, Azure, GCP) including storage, IAM, and networking concepts
- Kubernetes-based runtime environments (troubleshooting-focused)
- Strong scripting and automation skills (Python, Shell, Terraform) for platform operations
Company Overview