Our client, an established company in the software industry, operates a modern, cloud-based data platform in an AWS environment. To strengthen the team, we are looking for an experienced Senior Data Platform Engineer who is passionate about managing, optimizing, and further developing complex big data architectures.
Your responsibilities:
- Administration, monitoring, and optimization of a big data platform in the AWS Cloud
- Management and maintenance of Cloudera On-Cloud PaaS services as well as AWS-native technologies such as Kafka, Flink, NiFi, Iceberg Tables, and DynamoDB
- Deployment and automation of infrastructure in AWS using Terraform and ArgoCD
- Execution of updates, upgrades, and incident management for all platform components
- Advising data platform developers on selecting suitable services for business use cases
- Taking over 3rd-level support, including monitoring, error analysis, and troubleshooting to ensure a highly available system (including 24/7 on-call duty)
- Optimization of workloads, e.g.:
- Flink job memory management
- Impala and Trino query optimization
- Evaluation and implementation of cloud-native services in accordance with the existing system architecture
Your profile:
- Very good knowledge of Linux
- Strong experience with Hadoop services such as HDFS, Zookeeper, Yarn, Impala, Spark, and Kafka
- Experience with Terraform for infrastructure automation
- Programming skills in Spark and Python
- Practical experience with on-call duty and structured troubleshooting
- Team-oriented working style and strong team spirit
- Nice to have:
- Experience with Kubernetes
- Specific knowledge of Cloudera services such as HDFS, Zookeeper, Yarn, Impala, Hue, Spark, Kafka, Flink, Knox, Ranger RAZ, Streams Messaging Manager, NiFi, and Kudu
- Experience with rolling restarts in production environments
What you can look forward to:
- Hybrid working model and flexible working hours
- Individual training and development opportunities
- Working with modern cloud and big data technologies
- Meal allowance as well as free drinks and fruit
- Health initiatives and company pension scheme
- Team events and professional exchange in engineering communities
- Good public transport connections and parking facilities
- Support with any required relocation process
Verdiene 1000 € für eine erfolgreiche Empfehlung
Erstelle dir deinen persönlichen Empfehlungslink und verdiene 1000€ für jede erfolgreiche Empfehlung. Es gibt keine Begrenzung, wie viele Personen du weiterempfehlen kannst. Hier kannst du dir deinen Link für diesen Job erstellen, sende ihn an die passende Person, wenn sie sich darüber bewirbt und eingestellt wird bekommst du die 1000€.