Posted 9 days ago
Description
Our client, a prominent organization in the telecommunications sector, is looking for a Data Streaming Engineer to support their data transformation program. This role involves re-engineering the enterprise data platform and migrating systems to a modern Azure Cloud technology stack.
- Design and develop high-availability solutions for real-time data ingestion, processing, and serving.
- Collaborate with architects, data scientists, and project managers to drive the data transformation initiative.
- Develop generic frameworks for system monitoring and logging within the data ecosystem.
- Implement real-time processing workflows to handle large-scale data streams.
- Participate in the migration of on-premises data assets to the cloud platform.
- You bring 5+ years of experience in big data and data streaming engineering.
- You possess profound knowledge of backend development using Java and Python .
- You have extensive experience with Azure Cloud services, specifically ADLS , Azure Functions , and Event Hub .
- You have solid experience with real-time processing frameworks such as Spark Streaming and Kafka Streams .
- You possess knowledge of NoSQL databases like Couchbase .
- You have experience with CI/CD tools including Git , Jenkins , GitHub CI , and Nexus .
- You're a proactive team player with strong analytical and troubleshooting skills.
- You're able to work autonomously and cooperate effectively with onsite and offshore teams.
- You are fluent in English .
Nice to Haves
- Knowledge of Cloudera and Kafka on-premises operations.
- Experience with Azure Kubernetes Service (AKS) .
- Familiarity with Flink or Databricks structured streaming in real-time mode.
- Knowledge of Dutch and/or French .
- Start date: ASAP
- Duration: 6 months
- Work regime: Full-time
- Location: Brussels
- Working model: Hybrid
- Contract: open to both permanent employees and freelancers
