Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

The Data Engineer is responsible for building and maintaining scalable, reliable, and high-quality data pipelines and infrastructure that power data products and analytics across the organisation.

The role focuses on ensuring data is accurate, timely, and consistently processed, particularly in environments involving high-volume transactional and API-driven systems.

Key Responsibilities

1. Data Pipeline Development

  • Design, build, and maintain ETL/ELT pipelines

  • Ingest data from internal systems and external APIs

  • Develop scalable data processing workflows (batch and/or real-time)

  • Ensure pipelines are reusable, efficient, and maintainable

2. Data Integration

  • Integrate data from various sources, including transactional flows

  • Handle complex data scenarios such as:

    • Event sequencing (e.g. bet → resolve)

    • Idempotency and duplicate handling

    • Partial or delayed data

  • Ensure consistency between source systems and analytical datasets

3. Data Transformation & Modelling Support

  • Implement transformation logic aligned with architectural data models

  • Build and maintain structured data layers for analytics consumption

  • Collaborate closely with the Data Architect on model implementation

4. Data Quality, Monitoring & Reliability

  • Implement data validation, monitoring, and alerting mechanisms

  • Identify and resolve data inconsistencies or failures

  • Ensure high levels of data accuracy and availability

5. Performance & Scalability

  • Optimise pipelines for performance and cost-efficiency

  • Support scaling of data infrastructure as volumes grow

  • Ensure low-latency data availability where required

6. Collaboration

  • Work closely with Data Architect, Analysts, and Manager

  • Support Analysts by ensuring availability of curated datasets

  • Contribute to continuous improvement of data platform capabilities

Required Skills & Experience

  • 3–7+ years experience in data engineering, backend engineering, or similar roles

  • Strong programming skills (e.g. Python, SQL)

  • Solid understanding of ETL/ELT processes and data pipeline design

  • Experience working with APIs and integrating distributed systems

  • Experience handling transactional or event-based data

  • Strong understanding of:

    • Data transformation techniques

    • Data warehousing concepts

    • Data modelling fundamentals

  • Experience with data orchestration and workflow tools

  • Ability to build robust, fault-tolerant systems

  • Strong problem-solving skills with attention to detail and data accuracy

Nice to Have

  • Experience in iGaming, fintech, or high-volume transactional environments

  • Experience with event streaming technologies (e.g. Kafka)

  • Familiarity with modern data stack tools (e.g. Snowflake, BigQuery, dbt, Airflow)

  • Experience with real-time or near real-time data processing

  • Understanding of idempotent processing and event ordering

  • Exposure to CI/CD and infrastructure-as-code practices

  • Experience supporting analytics or BI teams

Success Metrics

  • Reliability and uptime of data pipelines

  • Data freshness and latency

  • Reduction in data errors and inconsistencies

  • Performance and scalability of data processing

  • Availability of high-quality, curated datasets for analysts

What’s in it for you?

  • Experience a dynamic and team-orientated work environment.

  • Opportunities for personal growth and learning

  • An open, inclusive and supportive team where you will be valued, and your suggestions will be welcome.

  • 26 days paid holiday per year. This is in addition to local bank holidays.

  • Competitive salary

  • €400 annual wellness Allowance

  • Hybrid Working

  • Risk Benefits such as pension, Life Assurance (4x annual salary),

  • Private Medical Insurance

  • Team Building Opportunities

  • Flexible core hours between 10am – 4pm

  • Receive support whenever you need it with our Employee Assistance Program, available 24/7.

  • Local discounts and more.

Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in London vacancy
  • £90k - £100k per annum

     ...Unlock the potential of data as a Databricks Data Engineer in a permanent hybrid role that embraces innovation and collaboration. In this position, you will leverage Azure Databricks and work with Microsoft B.I to drive impactful data solutions. This role is ideal for individuals... 
    Suggested
    Permanent
    Hybrid working

    Tenth Revolution Group

    London
    more than 2 months ago
  • £64k - £84k per annumEstimated
     ...order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics.  The Technology Department delivers...  ....  Act as a technical bridge between the Market Data Engineering team, downstream consumers (trading, risk, compliance), and external... 
    Suggested
    Immediate start

    Marex

    London
    12 days ago
  • £70k - £75k per annum

     ...to do it. AND WITH AI. An opportunity to get your hands down and dirty with data to help companies find the best talent. Specifically focusing on research, innovation, science and engineering. There is a huge and complex database,I am talking 2 million unique data points... 
    Suggested
    Permanent

    LinuxRecruit

    London
    more than 2 months ago
  • £54k - £72k per annumEstimated
     ...company is headquartered in London, with offices in Philadelphia, The Hague, Toronto, and Sydney. Role Overview The Data & Insight Engineer will build and own an AI-native analytics environment where insights are generated automatically from data rather than manually... 
    Suggested
    Full-time
    Hybrid working
    On-site

    Orgvue

    London
    22 days ago
  • £74k - £98k per annumEstimated
     ...provides the Intelligence Fabric for Capital Markets, a trusted data network and intelligence architecture that transforms fragmented...  ...AUM annually. The Opportunity: Rimes is looking for a Data Engineer to actively participate in building and modernising the data platform... 
    Suggested
    Long-term contract

    Rimes Technologies

    London
    21 days ago
  • £130k - £140k per annum

     ...Elevate your career as a Data Engineer in an innovative remote environment. We are seeking an experienced professional to design, implement, and maintain data solutions that drive insights and business value. Key Responsibilities and Skills: - Proficient in AWS and Google... 
    Permanent
    Remote

    Tenth Revolution Group

    London
    more than 2 months ago
  • £50k - £60k per annum

     ...Databricks Data Engineer | Azure | Databricks | Git | CI/CD | FinTech | London Hybrid Working 2/3 days per week | £50,000-£60,000 + bonus + benefits Method Resourcing are proud to be partnered with a financial services organisation who specialise in both asset and wealth... 
    Full-time
    Hybrid working
    On-site

    Method Resourcing

    London
    24 days ago
  • £60k - £78k per annumEstimated
     ...We're upgrading the foundation that captures algorithm decision data, moving from database logging to a versioned event stream with purpose...  .... With the growing adoption of our Monte Carlo simulation engine, we can understand the impact of changes to our algorithmic underwriting... 
    Full-time

    Ki

    London
    8 days ago
  • £59k - £78k per annumEstimated
     ...Marketing, so people ship real code and launch custom dashboards in minutes. Engineering commits are entirely AI-assisted, which shifts the focus from team size to the quality of your thinking, and our data warehouse connects directly to an AI assistant for instant answers.... 
    Full-time
    Hybrid working
    On-site
    Shift work

    Zego

    London
    5 days ago
  •  ...Citywire's data platform powers products across the company, both internal and external, from our industry ratings to our growing estate of production AI systems. We're hiring a Data Engineer to help build the pipelines and data models at the heart of it - taking requirements... 
    Flexible hours

    Citywire Financial Publishers Ltd

    London
    16 days ago
  • £55k - £74k per annumEstimated
     ...built to match the threat. Today, Ripjar's AI-native software and data fusion products are used by governments, the world's largest...  ...from our office at any time. About the Role We see a Data Engineer as a software engineer who specialises in distributed data systems... 
    Full-time
    On-site
    Remote

    Ripjar

    London
    22 days ago
  • £53k - £68k per annumEstimated
     ...growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and... 
    Hybrid working
    On-site

    DAINTTA

    London
    12 days ago
  • £42k - £56k per annumEstimated
     ...Elevate your career as a Data Engineer in a role that marries technical prowess with innovative solutions. This permanent, hybrid position offers an exciting opportunity to work with SAS products within a collaborative environment. Your expertise will be instrumental in... 
    Permanent
    Hybrid working

    Nigel Frank International

    London
    more than 2 months ago
  • £59k - £76k per annumEstimated
     ...independent assessment. You can learn more about Actis at . Key Purpose of Role General Atlantic is seeking an Associate-level Data Engineer to join the Data Strategy team. This role will report to the VP, Head of Data Engineering, and will work closely with senior data... 
    Long-term contract

    General Atlantic

    London
    a month ago
  • £47k - £62k per annumEstimated
     ...Google Role overview Given our exciting and progressive growth plans, we are looking for a skilled and experienced Senior Data Engineer to join our team. This role will report to the Head of Data & Infrastructure and play a key part in levelling up our infrastructure... 
    On-site
    Remote

    Fresha

    London
    more than 2 months ago
  • £51k - £66k per annumEstimated
     ...Job Description Job Title: Data Engineer with AI knowledge - Associate Manager Salary: Competitive salary and package (Depending on level of experience) Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout the... 

    Accenture

    London
    a month ago
  • £50k per annum

     ...with Microsoft Fabric, Azure, SQL and PySpark. Join a growing data function where you'll have real ownership and influence. We’re...  ...a significant data transformation and they’re looking for a Data Engineer to join their growing team. This is a hands-on Data Engineer role... 
    Permanent
    On-site
    Remote
    London
    7 days ago
  • £48k - £62k per annumEstimated
     ...The Data Engineer is responsible for building and maintaining scalable, reliable, and high-quality data pipelines and infrastructure that power data products and analytics across the organisation. The role focuses on ensuring data is accurate, timely, and consistently processed... 
    Hybrid working
    Flexible hours

    Eeze

    London
    27 days ago
  •  ...web, apps, social media, podcasts, email, YouTube, syndication partners and print. The role and the team We are looking for a Data Engineer to join our team. They will be responsible for maintaining and supporting the existing data infrastructure used to underpin our... 

    Independent Media

    London
    1 day ago
  • £50k - £70k per annum

     ...Unlock your potential as a Data Engineer in a flexible, remote role focused on leveraging Microsoft Business Intelligence. Our client is seeking a skilled Data Engineer to join their innovative environment. This permanent position invites you to make a meaningful impact... 
    Permanent
    Remote
    Flexible hours

    Tenth Revolution Group

    London
    more than 2 months ago
  • £50k - £65k per annum

     ...space. The company is scaling rapidly following recent growth, with data at the centre of how it drives performance, commercial outcomes...  .... It’s a collaborative, ambitious environment that appeals to engineers who want ownership, variety and progression as the company continues... 
    Permanent
    Hybrid working

    Tenth Revolution Group

    London
    more than 2 months ago
  • £48k - £63k per annumEstimated
     ...need to outmanoeuvre the competition and are passionate about disrupting an established category      Role Overview As a TSW data engineer you will be a key member of a dynamic media activation team, and a critical part of our service delivery to clients. You will... 
    Long-term contract
    Full-time
    On-site
    Remote

    The Specialist Works

    London
    13 days ago
  • £56k - £74k per annumEstimated
    Data Engineer - Outside IR35 We are looking for data engineers with data analysis and engineering expertise. Skills: - Advanced SQL - for high-performance data transformation, exploration, and optimisation across large, complex datasets - Cloud-Based ETL & Data Warehousing... 
    Full-time
    On-site

    LA International Computer Consultants Ltd

    London
    2 days ago
  • £350 - £365 per day

     ...An exciting media agency in London is looking for a Data Engineer to support a leading client, helping to build a new marketing data capability within Snowflake and enable reporting, analytics and measurement. ~ Based in London - fully in the office ~3 days per week... 
    On-site
    Immediate start
    3 days/week

    Sphere Digital Recruitment

    City of London, Greater London
    12 hours ago
  • £39k - £52k per annumEstimated
     ...private sector to design and build products, platforms and services that genuinely make a difference to users. We’re looking for a Data Engineer who enjoys working with data, technology and users to solve real problems. Someone who is comfortable working in delivery teams,... 

    UBDS Group

    London
    22 days ago
  • £34k - £45k per annumEstimated
     ...our clients transform their business, from strategy through implementation and business transformation. We are looking for a Data Engineer to join our excellent Data Solutions team in London. We implement data analytics platforms for our customers based on the Modern... 
    On-site

    Spaulding Ridge

    London
    a month ago
  • £75k per annum

     ...ETL Data Engineer – Fintech To £75,000 + 10% no-cont pension, bonus and shares Remote with occasional travel to the London Office. Quant Capital is urgently looking for a Data Engineer to join our well-known Fintech50 client who produces software disrupting... 
    On-site
    Immediate start
    Remote

    Quant Capital

    London
    more than 2 months ago
  • £42k - £57k per annumEstimated
     ...organisations solve complex challenges through strategy, design, engineering, and delivery. We work closely with our clients to deliver...  ...engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive... 
    Full-time
    Flexible hours

    Solirius Reply

    London
    22 days ago
  • £65k - £86k per annumEstimated
     ...lay the foundations for further and sustained success. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact... 
    Full-time

    Ki

    City of London, Greater London
    8 days ago
  • £50k - £70k per annum

     ...Unlock your potential as a Data Engineer in a permanent onsite role, where your expertise in MS Business Intelligence will play a crucial part in shaping data-driven decision-making. In this position, you will: - Utilize Microsoft Business Intelligence tools to design... 
    Permanent

    Tenth Revolution Group

    London
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!