Sr. Data Engineer

Data Engineer – Data Engineering

Job Title

Data Engineer – Data Engineering Experience 4+ Years

Job Type

Full-Time

Location

Remote / As per business requirement

Job Summary

We are looking for an experienced Data Engineer with 4+ years of hands-on experience in designing and developing scalable data engineering solutions.

The ideal candidate

should have strong expertise in Python PySpark Apache Spark AWS and Azure along with experience handling large and complex datasets. The candidate will be responsible for developing complex ETL/data transformation pipelines working with cloud data engineering services supporting data modeling initiatives and independently leading data engineering projects.

Key Responsibilities

Handle large complex multi-dimensional datasets including structured unstructured and real-time data. Design and develop complex data transformation and ETL pipelines using Python PySpark and Apache Spark. Work extensively with AWS and Azure cloud services within the data engineering ecosystem. Design develop and maintain scalable reliable and high-performance data pipelines. Work with on-premises and cloud-based data warehouses and understand their architecture. Develop and maintain data models based on business and technical requirements. Independently lead and deliver data engineering projects from requirements through implementation. Troubleshoot and resolve data engineering performance scalability and pipeline-related issues. Ensure data pipelines and processes meet required standards for scalability reliability efficiency and data quality. Stay updated with emerging data engineering tools technologies and industry best practices. Collaborate with Data Scientists Data Analysts Business Stakeholders and other technical teams to understand requirements and deliver effective solutions. Prepare and maintain technical specifications architecture/design documents and technical best practices. Communicate complex technical and design concepts effectively to technical and non-technical stakeholders. Contribute to team objectives and collaborate effectively to deliver project requirements. Required

Skills

4+ years of experience in Data Engineering Strong hands-on experience with Python Strong experience with PySpark and Apache Spark Experience developing ETL/ELT and data transformation pipelines Hands-on experience with AWS and Azure Strong understanding of cloud-based data engineering services Experience with AWS Glue EMR Azure Data Factory or similar services Strong understanding of Data Warehousing Experience with On-Premise and Cloud Data Warehouse environments Knowledge of Data Modeling concepts and principles Strong analytical problem-solving and troubleshooting skills Excellent communication and stakeholder-management skills Good to Have Experience or knowledge of the following will be an added advantage Snowflake Dataiku Alteryx Other modern cloud data engineering technologies and platforms

Qualification

Bachelor's Degree in Computer Science Information Technology Engineering or a related discipline. Equivalent practical experience may also be considered.

What We're Looking For

Ability to work independently and take ownership of projects. Strong technical leadership and decision-making capabilities. Ability to translate complex business requirements into scalable data engineering solutions. Strong communication skills with the ability to explain complex technical concepts clearly. Passion for learning emerging data engineering technologies and best practices. Pay Up to ₹100000.00 per year

Work Location

Remote