Lead Data Engineer

Hiring Lead Data Engineer Experience 10–15+ Years Engagement Freelance / Project-Based

Location

Remote We are looking for a Lead Data Engineer to provide technical leadership for the development of a highly scalable distributed data platform supporting real-time logistics IoT and enterprise data workloads.

Key Responsibilities

Lead the design and implementation of large-scale data engineering solutions Architect real-time and batch data pipelines for high-volume data sources Design distributed streaming architectures for IoT telemetry and event-driven workloads Lead CDC implementation for integrating legacy and modern data systems Design solutions for dynamic schema evolution without pipeline downtime Architect scalable data lakes/lakehouses using open table formats Establish data governance lineage quality and observability standards Design fault-tolerant and self-healing data pipelines Support multi-cloud data engineering architectures Optimize distributed processing and storage for large-scale workloads Collaborate with Solution Architects DevOps/SecOps and Data Science teams Mentor Senior and Junior Data Engineers and provide technical direction Required Expertise ✅ 10–15+ years of Data Engineering experience ✅ Strong Python SQL and distributed data processing expertise ✅ Apache Spark / PySpark ✅ Kafka or equivalent streaming technologies ✅ CDC and real-time data integration ✅ Data Lake / Lakehouse architecture ✅ Delta Lake Apache Iceberg or Apache Hudi ✅ Cloud platforms — AWS / Azure / GCP ✅ ETL/ELT and data pipeline architecture ✅ Data governance lineage and data quality ✅ Airflow or equivalent orchestration platforms ✅ Strong understanding of distributed systems and scalability Preferred IoT Data

Logistics

/ Supply Chain Mainframe Integration Schema Evolution Data Mesh Real-Time Analytics Multi-Cloud High Availability Pay ₹1500000.00 - ₹1800000.00 per year

Work Location

Remote