Data Engineer
Qeu
3–5 years of experience
Design, construct, and maintain highly scalable and robust ETL/ELT data pipelines from the ground up.
Extract and harmonize complex data structures from Microsoft Dynamics and SQL Server into a centralized, analytics-ready single source of truth.
Implement rigorous data quality checks, cleansing processes, and automated alerting to ensure AI models are fed with trusted, validated, and high-quality data.
Work side-by-side with AI Product Managers, ML Engineers, and Business Analysts to transform raw data into actionable fuel for predictive models such as dynamic pricing engines and AI solutions.
Champion data governance, ensuring all data infrastructure complies with privacy regulations and security best practices.
Advanced proficiency in SQL and Python data manipulation and pipeline development.
Deep expertise in the Microsoft data ecosystem, specifically Azure Synapse Analytics, Azure Data Factory (ADF), and SQL Server.
Strong expertise in building and orchestrating data pipelines using tools like Apache Airflow, dbt, or similar technologies.
Experience with big data processing frameworks such as Apache Spark and Kafka.
Problem-solving mindset with a relentless focus on performance optimization and system reliability (Uptime & Low Latency).
Previous experience working with retail, e-commerce, or supply chain data.
Previous experience extracting and transforming data from Microsoft Dynamics using Azure Synapse Link or custom API connectors.
Familiarity with Machine Learning lifecycles and MLOps tools.
Knowledge of regional data privacy frameworks (e.g., PDPL).
Must be open to relocation to Jeddah, Saudi Arabia.
2 months ago
last month
3 days ago