Data Streaming Engineer
Posted 76 days ago60-75K €€€ - regular contract or B2B Job Reference: 36034
We are seeking a talented Data Streaming Engineer to join our innovative team in the iGaming & online casinos industry. As a key member of our team, you will be instrumental in building and supporting our on-premises data streaming architecture, ensuring the delivery of scalable, high-throughput, and reliable solutions crucial for real-time analytics and decision-making.
Main responsibilities:
Main responsibilities:
- Lead the design and implementation of scalable data streaming solutions using Apache Kafka, with a primary focus on on-prem deployments.
- Develop and maintain event-driven architectures and streaming ETL processes, integrating Apache Spark or Apache Flink for advanced data processing and analytics capabilities.
- Optimize on-prem data streaming solutions for performance, reliability, and scalability to meet evolving business needs.
- Establish robust support and maintenance protocols for our on-prem data streaming infrastructure, ensuring continuous operational efficiency.
- Spearhead efforts in securing data, implementing encryption, and compliance measures for on-prem data processing in adherence to industry standards.
- Troubleshoot and resolve issues in the data streaming architecture, providing expert guidance and technical support to the team.
- Stay updated on emerging technologies and tools in the streaming ETL and data processing space, evaluating their potential to enhance our system capabilities.
- Proven experience with Apache Kafka, event sourcing, and streaming ETL technologies, specifically tailored to on-prem deployments.
- Programming skills (Java, Scala, or Python).
- Preferred: Experience with Apache Spark or Apache Flink for data processing.
- Demonstrated capability in designing and supporting on-prem data streaming architectures, including performance optimization and troubleshooting.
- Deep understanding of data security, encryption, and compliance frameworks relevant to on-prem data processing.
- Exceptional problem-solving skills, effective communication, and project management abilities.
Consultant
