Lakehouse Architecture & Implementation: Design and deploy a unified Data Lakehouse utilizing the Medallion architecture (Bronze, Silver, Gold) and open table formats (e.g., Delta Lake, Apache Iceberg) on cloud infrastructure hosted within Saudi Arabia.
Data Ingestion & Pipeline Engineering: Build reusable, automated ingestion frameworks (batch and streaming) capable of processing both structured data (RDBMS, APIs) and unstructured data (PDFs, policy documents) to feed downstream AI models and semantic reasoning engines.
Data Quality & Governance: Implement automated data quality "circuit breakers" (completeness, uniqueness, referential integrity) and end-to-end data lineage tracking frameworks.
Optimization: Optimize data processing workflows for performance, scalability, and cost-efficiency.
System Monitoring and Maintenance: Monitor and maintain data systems, responding to SEVs or other urgent issues to ensure continuous operations.
Security & Compliance: Ensure the platform adheres strictly to NCA (National Cybersecurity Authority) and NDMO (National Data Management Office) standards. Implement AES-256 encryption at rest, TLS 1.2+ in transit, robust Key Management Systems (KMS), and centralized audit logging.
Access Control Integration: Design and deploy granular Role-Based Access Control (RBAC) and Attribute-Based Access Control (ABAC), integrating seamlessly with existing enterprise Identity Providers (e.g., Active Directory).
Capability Building & Handover: Lead hands-on knowledge transfer sessions, pair-programming with client engineers, creating operational runbooks, and conducting "Game Day" failure simulations to ensure the client s team is fully ready to operate the platform independently.
