All vacancies

Senior Data Engineer

· office · senior · full-time
aianalyticsdev PythonApache SparkHadoop ecosystemSQLGitBig Data architecturesdistributed systemsAgileScrum
5.8
AI Score
The vacancy is detailed in tasks and requirements but lacks compensation information and company context.
no company infono salary info
Job description
We are looking for a Senior Data Engineer with over 6 years of relevant experience to design and implement high-performance data processing pipelines in Dubai office.
Responsibilities
• Gather and analyze business and technical requirements. • Conduct exploratory data analysis (EDA) to assess data quality and suitability. • Load, process, and transform large-scale datasets. • Design and implement high-performance, secure, and scalable data processing pipelines. • Apply feature engineering methods to support machine learning models. • Optimize Spark tasks and distributed data processing processes. • Collaborate closely with Analytics Delivery leads, Data Scientists, and cross-functional teams in an Agile environment. • Effectively interact with stakeholders to ensure project alignment and successful implementation.
Requirements
• Fluent English is mandatory. • Over 6 years of relevant experience in Data Engineering and ML pipeline development. • Proficient in Python, Apache Spark, Hadoop ecosystem, SQL, Git, Big Data architectures, and distributed systems. • Experience with Agile/Scrum methodologies.
Conditions
• Full-time employment. • Office location in Dubai.
Apply to this role