Senior Data Engineer

ventureslab All jobs
Malta Remote
4 day(s) ago
Job Overview
Company ventureslab
Job TypeEmployee full-time
CategoryTechnology
First Seen 4 day(s) ago

Job Description

ABOUT US Ventures Lab is an international company with over 200 employees specializing in the iGaming and Fintech industries. We deliver a diverse portfolio of products and services including iGaming verticals electronic payment solutions and managed services for customer operations. By leveraging technology and driving innovation we empower our partners to achieve greater success in competitive markets. Our global reach and expertise make us a trusted partner for cutting-edge solutions. THE ROLE The Senior Data Engineer is responsible for designing building and maintaining scalable data infrastructure that enables reliable data collection processing integration and analysis across the business. The role ensures that data pipelines models and platforms are robust secure efficient and aligned with business and regulatory requirements. Reporting to the Head of Data the Senior Data Engineer plays a key role in developing batch and real-time data solutions supporting data architecture improving data quality and governance and automating data workflows. The position contributes to the stability performance and scalability of the company’s data ecosystem enabling teams across the organisation to access accurate and timely data for operational and strategic decision-making. RESPONSIBILITIES Data Architecture Design and implement robust scalable data architecture to support thecollection storage and processing of large volumes of igaming and customer data. ETL Development Build and maintain efficient ETL and ELT processes to ensure seamless dataingestion from multiple sources into our data lake DWH and final consumers. Data Modeling Create and maintain well-structured data models that ensure accuracyintegrity and optimal performance for analytical use cases following Kimball best practices. Data Integration Collaborate with cross-functional teams to integrate data across systemswith several types of integration as API Kafka DB extractions Webscrapping Email etc. Streaming & Real-Time Processing Develop and manage real-time data pipelines usingstreaming technologies (e.g. Kafka) to support time-sensitive use cases. Data Quality & Governance Enforce data governance policies and best practices ensuringhigh standards for data quality security and regulatory compliance. Performance Optimization Continuously monitor troubleshoot and optimize data pipelinesqueries and infrastructure for speed efficiency and reliability. Pipeline Orchestration Support and expand production-grade orchestration workflows usingApache Airflow. Observability & Monitoring Set up and maintain monitoring alerting and observability fordata pipelines and systems using tools like Elementary Datadog Prometheus or Grafana. CI/CD and Automation Develop and maintain CI/CD pipelines for data projects usingBitbucket Pipelines or GitHub Actions ensuring streamlined deployment and testingprocesses. Version Control & Collaboration Follow best practices in Git-based version control and workcollaboratively in a modern DevOps environment. QUALIFICATION SKILLS & EXPERIENCE 5+ years of experience with Python preferably including 2+ years working with Airflow. 5+ years of experience with SQL in big data environments preferably including 2+ years withdbt. 4+ years in cloud environments preferably with 2+ years each in Snowflake and AWS. 2+ years of experience with data streaming platforms preferably on Kafka. 2+ years of hands-on experience with containerization (Docker Kubernetes). 3+ years managing CI/CD pipelines ideally using Bitbucket Pipelines or GitHub Actions. Deep understanding of data governance data quality and data lineage principles. Proficient in using monitoring and alerting tools such as Datadog Prometheus or Grafana. Solid experience with version control tools (Git) and IaaS (e.g. Terraform). Strong communication and problem-solving skills with a proactive and self-driven attitude. OUR OFFER Competitive salary synonymous with skills and experience Performance and bonus structure dependent on achievement of set targets and personal performance The opportunity to making a real impact at a time of rapid growth Consultancy B2B contract on a full time basis with 25 days PTO

Unlock: Sign Up for free / Sign In and use the searches from your home page or the links in the footer.