Mid Data Platform Engineer

Fluent in written and spoken Portuguese and English. 30 days’ notice period for termination The candidate can work remotely from any Portuguese region What you will be doing We're looking for a Data Engineer to support and develop a data platform within a large-scale international energy provider. Provide user support for the data platform troubleshooting and fixing issues Support data pipelines and ETL/ELT processes to enable reliable and scalable data flows Collaborate with platform architects to ensure the data platform is efficient secure and highly available Improve data processes monitoring performance and platform efficiency Support data quality frameworks and monitoring to ensure accuracy consistency and completeness of data pipelines Support for data lakes data warehouses and data streaming solutions Work with stakeholders (data scientists analysts business users) to solve issues in the data platform Automate repeatable tasks and improve the data ingestion transformation and delivery processes Troubleshoot and optimize data workflows and SQL queries for performance and cost efficiency Document data platform changes processes and best practices Review evaluate and approve data product releases to production.

What we are looking for

Experience with data pipelines in a production environment Strong hands-on knowledge of SQL and experience with distributed data processing (e.g. Apache Spark) Proficiency and knowledge of troubleshooting dbt Apache Kafka Apache Ignite Apache NiFi and Apache AirFlow Proficiency in a programming language such as Python or Scala for data engineering tasks Experience with cloud data services (AWS) Familiarity with Grafana tools Knowledge of data governance security and compliance in a cloud environment Experience implementing CI/CD and testing frameworks for data workflows Strong problem-solving skills communication skills and passion for collaboration. What can you expect from us? Mind-blowing workplace culture. You will be integrated in a professional dynamic and collaborative team. 100% Remote opportunities We want you to have the flexibility to work where you feel most comfortable and productive. International Career You can expect professional growth and to be connect with the world. We are represented in Portugal Belgium Luxembourg and Denmark. And with projects in many other countries Netherlands Luxembourg Singapore and in the United States of America (and a lot more is coming…) Extra

Benefits

& Perks If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company We will help! As a plus we provide Health and Life Insurance.