Senior Data Engineer( Snowflake , Azure)

3pillarglobal All jobs
India
4 hour(s) ago Remote
Job Overview
Company 3pillarglobal
WorkplaceRemote
Job Typefulltime
CategoryProduct Development – Product Development
First Seen 4 hour(s) ago

Job Description

3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America Europe Latin America and Asia we work with the most ambitious companies in financial services healthcare media and technology — helping them move faster modernize boldly and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open portable and built to last. We are building the future of enterprise AI   ➡ Key Responisiobilities ➡ Understanding the business requirements Writing code and implementing the proposed solutions Creating data pipelines versioning and change management Manage the complexity inherent in versioned data pipelines Develop ETL/ELT processes to help extract and manipulate data from multiple sources. Design build and maintain batch or real-time data pipelines in production. Automate data workflows such as data ingestion aggregation and ETL processing. Logging and instrumentation of pipelines and services. Ensure data accuracy integrity privacy security and compliance through quality control procedures. Train and mentor junior engineers. Minimum Qualifications ➡ Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role Advanced SQL skills and experience with relational databases and database design. Experience working with cloud Data Warehouse solutions (e.g. Snowflake Redshift BigQuery Azure Synapse etc.). Strong Python skills with hands-on experience on Pandas NumPy and other data related libraries Experience with Big Data technologies like Spark Map Reduce Hadoop Hive etc Proficiencient in data pipeline and workflow management tools e.g. Airflow Experience with data visualization tools like PowerBI Tableau AWS QuickSight etc Experience with the AWS/Azure/GCP data engineering services Knowledge of AWS services viz. S3 Lambda EMR GLUE ETL Athena RDS Redshift EC2 IAM OR Knowledge of Azure services viz. ADF Azure Synapse Analytics ADLS Gen2 Azure SQL DB Very good exposure of working on Data Lakes & Data Warehouses solutions Excellent problem-solving communication and organizational skills. Proven ability to work independently and with a team. Ability to guide other data engineers. Additional Experience ➡ Experience working with data ingestion tools such as Fivetran stitch or Matillion. Good understanding of NoSQL databases like Redis Cassandra MongoDB or Neo4j. Familiarity with machine learning technologies. Experience in Java or Scala ➡ What It's Like to Work at 3Pillar At 3Pillar we create an environment where people can do their best work while maintaining a healthy work-life balance. Flexibility & Well-being – Our remote-first approach gives you the flexibility to work where you perform best while prioritizing your well-being and personal commitments. Global Community – Collaborate with talented colleagues across the globe in a culture built on connection support and shared success. Your Voice Matters – We foster open communication and multiple feedback channels ensuring every employee has the opportunity to be heard and make an impact. Growth & Development – Gain exposure to diverse clients industries and challenges that accelerate learning and career growth. Our culture is guided by four core values Collaboration Outperform Respect and Evolve—the principles that shape how we work grow and succeed together.

Unlock: Sign Up for free / Sign In and use the searches from your home page or the links in the footer.