Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

The Data Engineer is responsible for building and maintaining scalable, reliable, and high-quality data pipelines and infrastructure that power data products and analytics across the organisation.

The role focuses on ensuring data is accurate, timely, and consistently processed, particularly in environments involving high-volume transactional and API-driven systems.

Key Responsibilities

1. Data Pipeline Development

  • Design, build, and maintain ETL/ELT pipelines

  • Ingest data from internal systems and external APIs

  • Develop scalable data processing workflows (batch and/or real-time)

  • Ensure pipelines are reusable, efficient, and maintainable

2. Data Integration

  • Integrate data from various sources, including transactional flows

  • Handle complex data scenarios such as:

    • Event sequencing (e.g. bet → resolve)

    • Idempotency and duplicate handling

    • Partial or delayed data

  • Ensure consistency between source systems and analytical datasets

3. Data Transformation & Modelling Support

  • Implement transformation logic aligned with architectural data models

  • Build and maintain structured data layers for analytics consumption

  • Collaborate closely with the Data Architect on model implementation

4. Data Quality, Monitoring & Reliability

  • Implement data validation, monitoring, and alerting mechanisms

  • Identify and resolve data inconsistencies or failures

  • Ensure high levels of data accuracy and availability

5. Performance & Scalability

  • Optimise pipelines for performance and cost-efficiency

  • Support scaling of data infrastructure as volumes grow

  • Ensure low-latency data availability where required

6. Collaboration

  • Work closely with Data Architect, Analysts, and Manager

  • Support Analysts by ensuring availability of curated datasets

  • Contribute to continuous improvement of data platform capabilities

Required Skills & Experience

  • 3–7+ years experience in data engineering, backend engineering, or similar roles

  • Strong programming skills (e.g. Python, SQL)

  • Solid understanding of ETL/ELT processes and data pipeline design

  • Experience working with APIs and integrating distributed systems

  • Experience handling transactional or event-based data

  • Strong understanding of:

    • Data transformation techniques

    • Data warehousing concepts

    • Data modelling fundamentals

  • Experience with data orchestration and workflow tools

  • Ability to build robust, fault-tolerant systems

  • Strong problem-solving skills with attention to detail and data accuracy

Nice to Have

  • Experience in iGaming, fintech, or high-volume transactional environments

  • Experience with event streaming technologies (e.g. Kafka)

  • Familiarity with modern data stack tools (e.g. Snowflake, BigQuery, dbt, Airflow)

  • Experience with real-time or near real-time data processing

  • Understanding of idempotent processing and event ordering

  • Exposure to CI/CD and infrastructure-as-code practices

  • Experience supporting analytics or BI teams

Success Metrics

  • Reliability and uptime of data pipelines

  • Data freshness and latency

  • Reduction in data errors and inconsistencies

  • Performance and scalability of data processing

  • Availability of high-quality, curated datasets for analysts

What’s in it for you?

  • Experience a dynamic and team-orientated work environment.

  • Opportunities for personal growth and learning

  • An open, inclusive and supportive team where you will be valued, and your suggestions will be welcome.

  • 26 days paid holiday per year. This is in addition to local bank holidays.

  • Competitive salary

  • €400 annual wellness Allowance

  • Hybrid Working

  • Risk Benefits such as pension, Life Assurance (4x annual salary),

  • Private Medical Insurance

  • Team Building Opportunities

  • Flexible core hours between 10am – 4pm

  • Receive support whenever you need it with our Employee Assistance Program, available 24/7.

  • Local discounts and more.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer in London vacancy
  • £52k - £67k per annumEstimated
     ...Role: Engineering Manager Contract: Permanent Salary: Competitive Location: London / Oxford   Security clearance: This role requires...  ...platform: the intelligence layer that fuses multi-modal data, including text, imagery, telemetry and sensor feeds, so operators... 
    Suggested
    Permanent
    Full-time
    Hybrid working
    Flexible hours

    Oxford Dynamics

    London
    16 days ago
  • £75k per annum

     ...ETL Data Engineer – Fintech To £75,000 + 10% no-cont pension, bonus and shares Remote with occasional travel to the London Office. Quant Capital is urgently looking for a Data Engineer to join our well-known Fintech50 client who produces software disrupting... 
    Suggested
    On-site
    Immediate start
    Remote

    Quant Capital

    London
    more than 2 months ago
  • £350 - £400 per day

     ...? Out-of-Home (OOH) ? Organic / LLM Optimisation ? Strategy & Data Consultancy ? In-housing support They operate at the intersection...  ...The Individual We are looking for a hands-on Data Engineer to help us transition from an early-stage data setup into a scalable... 
    Suggested

    Sphere Digital Recruitment

    City of London, Greater London
    a month ago
  • £52k - £69k per annumEstimated
     ...About the Position We are looking for a Data Engineer to turn messy, real-world datasets into reliable inputs for research and trading. Jane Street depends on data from a wide variety of sources to understand markets and the global economy—think world news, decades of weather... 
    Suggested
    Full-time

    Jane Street

    London
    19 days ago
  • £50k - £70k per annum

     ...Unlock your potential as a Data Engineer in a permanent onsite role, where your expertise in MS Business Intelligence will play a crucial part in shaping data-driven decision-making. In this position, you will: - Utilize Microsoft Business Intelligence tools to design... 
    Suggested
    Permanent

    Tenth Revolution Group

    London
    more than 2 months ago
  • £60k - £65k per annum

     ...Are you ready to make an impactful contribution in the field of data engineering? This role offers an exciting opportunity to work with cutting-edge Azure Data solutions in a hybrid setting based in Brentford. As a key player in this role, you will be responsible for managing... 
    Permanent
    Hybrid working
    Flexible hours

    Nigel Frank International

    London
    more than 2 months ago
  • £41k - £53k per annumEstimated
     ...Robert Half Technology are assisting UK's market leading telecommunications organisation to recruit a Data Engineer on a contract basis - Hybrid working - London / Hampshire based We are supporting a data transformation programme and are looking for a Senior Data / Platform... 
    Hybrid working

    Robert Half

    London
    a month ago
  • £64k - £84k per annumEstimated
     ...Please see below an outline of the responsibilities of the role as well as the requirements. About the role We’re looking for a Data Engineer with 2+ years’ experience to join our growing data engineering capability. This role is focused on client delivery. You’ll work... 
    Hybrid working
    Flexible hours

    Alpha Financial Markets Consulting

    London
    8 days ago
  •  ...Data Engineer Location: London (Paddington) · Hybrid (3 days in-office) · Full-time About wawa fertility 17% of adults worldwide need help to have a baby and by 2050, that number will reach nearly 50%. Yet only 2% can access fertility treatment today. That’s not a... 
    Full-time
    Live-in
    Hybrid working
    On-site
    Flexible hours
    Day shift

    Wawa Fertility

    London
    a month ago
  •  ...promise you’ll become the next Tiger Woods. What we truly seek is a genuine passion for travel and an eagerness to learn. As a Data Engineer primarily supporting Your Golf Travel and Premier Golf US- with opportunities to assist across the wider Palatinate Group- you will... 

    Your Golf Travel

    London
    2 days ago
  • £43k - £56k per annumEstimated
     ...About the Role This is a technical role within the Telegraph Data team. Working closely with a cross functional team of Data Engineers, Analysts and Scientists, youʼll be an integral part of the Data Engineering chapter - driving evolution of the data architecture, and... 
    Long-term contract
    Full-time
    Flexible hours

    The Telegraph

    London
    26 days ago
  • £42k - £54k per annumEstimated
     ...Data Engineer Data Engineer - London (Hybrid) Data Engineer wanted for a leading independent media and marketing business operating at the intersection of data, technology and advertising. Sphere are partnered with a high-growth agency who are looking to hire a Data... 
    Permanent
    Hybrid working

    Sphere Digital Recruitment

    City of London, Greater London
    a month ago
  • £47k - £62k per annumEstimated
     ...Google Role overview Given our exciting and progressive growth plans, we are looking for a skilled and experienced Senior Data Engineer to join our team. This role will report to the Head of Data & Infrastructure and play a key part in levelling up our infrastructure... 
    On-site
    Remote

    Fresha

    London
    more than 2 months ago
  • £58k - £87k per annum

     ...intelligence does. For more than 30 years, we have been building the data foundations that make intelligent systems work — designing the...  ...(Principal Level) What You'll Architect As a Market Data Engineer , you will help organisations transform complexity into... 
    Full-time
    Fixed-term contract
    Hybrid working
    On-site
    Immediate start

    Keyrus UK

    London
    22 days ago
  • Company: HUXLEY ASSOCIATES Job Type: Contract, Full Time Salary: £500/hour
    Full-time

    HUXLEY ASSOCIATES

    London
    a month ago
  • £50k per annum

     ...with Microsoft Fabric, Azure, SQL and PySpark. Join a growing data function where you'll have real ownership and influence. We’re...  ...a significant data transformation and they’re looking for a Data Engineer to join their growing team. This is a hands-on Data Engineer role... 
    Permanent
    On-site
    Remote
    London
    24 days ago
  • £10k per annum

     ...end services, from strategy through implementation, accelerated by data, digital and AI.  We shape opinion through evidence-based...  ...delivering positive and meaningful change.  About the role The Data Engineer sits within the Data Innovation team and works day-to-day on the... 
    Long-term contract
    Full-time
    Apprenticeship
    Hybrid working
    Remote
    Work from home
    Flexible hours

    Carnall Farrar

    London
    18 days ago
  • £51k - £66k per annumEstimated
     ...Job Description Job Title: Data Engineer with AI knowledge - Associate Manager Salary: Competitive salary and package (Depending on level of experience) Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout the... 

    Accenture

    London
    8 days ago
  • £50k - £67k per annumEstimated
     ...of policies and raised over $200 million in funding. And we’re only just getting started. About the Role We're looking for a Data Engineer to join our data engineering function, helping to build and maintain the data platform that powers Zego's ambitious growth.... 
    Full-time
    Hybrid working
    On-site
    Work from home
    Flexible hours

    Zego

    London
    19 days ago
  • £48k - £63k per annumEstimated
     ...Position Overview As a Data Engineer at Circadia Health , you will play a critical role in building and maintaining the data infrastructure that powers Circadia’s AI-driven clinical monitoring platform. You will design and operate robust data pipelines that ingest, transform... 
    Full-time

    circadiahealth

    Vauxhall, Greater London
    24 days ago
  • £130k - £140k per annum

     ...Elevate your career as a Data Engineer in an innovative remote environment. We are seeking an experienced professional to design, implement, and maintain data solutions that drive insights and business value. Key Responsibilities and Skills: - Proficient in AWS and Google... 
    Permanent
    Remote

    Tenth Revolution Group

    London
    more than 2 months ago
  • £500 per day

    Quick one, this isn’t a typical Data Engineer role. I’m working with a business in London building an AI-driven HR Platform for the commercial property space. They’re looking for their data engineering hire to design and build it end-to-end. • Desinging and building a... 
    Full-time
    On-site

    Trust In SODA

    London
    2 days ago
  • $115k - $125k per annum

     ...ABOUT THIS POSITION We are seeking a Principle Data Engineer with extensive experience in data infrastructure to join our team. Unlike many modern roles that rely entirely on cloud-managed services, this position is looking for someone to manage our self-hosted and on... 
    Flexible hours

    Digital Extremes

    London
    a month ago
  • £80k per annum

     ...An impressive multinational firm is looking for an accomplished Data Engineer to join its team. Please note the role is hybrid you will work from the office 3 days per week with 2 from home. In this role, you will be responsible for designing, developing, and maintaining... 
    Permanent
    Hybrid working
    On-site

    Ashdown Group

    Richmond, Greater London
    1 day ago
  • £44k - £59k per annumEstimated
     ...for the world’s leading brands. With exceptional talent, trusted data and intelligence, and world-class partnerships – all united by our...  ...For more information, visit wppmedia.com .   1344 - Data Engineer Role Summary and Impact This role forms part of a data engineering... 
    Hybrid working
    On-site

    WPP Media

    London
    25 days ago
  • £42k - £56k per annumEstimated
     ...Elevate your career as a Data Engineer in a role that marries technical prowess with innovative solutions. This permanent, hybrid position offers an exciting opportunity to work with SAS products within a collaborative environment. Your expertise will be instrumental in... 
    Permanent
    Hybrid working

    Nigel Frank International

    London
    more than 2 months ago
  • £53k - £68k per annumEstimated
     ...growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and... 
    Hybrid working
    On-site

    DAINTTA

    London
    18 days ago
  • £59k - £76k per annumEstimated
     ...independent assessment. You can learn more about Actis at . Key Purpose of Role General Atlantic is seeking an Associate-level Data Engineer to join the Data Strategy team. This role will report to the VP, Head of Data Engineering, and will work closely with senior data... 
    Long-term contract

    General Atlantic

    London
    15 days ago
  •  ...Java Data Engineer Hybrid Working (6 days per month onsite in our Farringdon office) Who are we? Toyota Connected Europe wants to create a better world through connected mobility for all. We are a new company created to bring big data and a customer focus into all... 
    Hybrid working
    On-site
    Immediate start

    Toyota Connected Europe

    London
    more than 2 months ago
  •  ...Data Engineer – Mid level Greece Role type: Permanent Location: Greece Data Engineer required to join our Satalia team. As an organisation, we push the boundaries of data science, optimisation and artificial intelligence to solve the most complex problems in the... 
    Permanent
    Remote
    Flexible hours

    Satalia

    London
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!