The Data Engineer is responsible for building and maintaining scalable, reliable, and high-quality data pipelines and infrastructure that power data products and analytics across the organisation.
The role focuses on ensuring data is accurate, timely, and consistently processed, particularly in environments involving high-volume transactional and API-driven systems.Key Responsibilities
1. Data Pipeline Development
Design, build, and maintain ETL/ELT pipelines
Ingest data from internal systems and external APIs
Develop scalable data processing workflows (batch and/or real-time)
Ensure pipelines are reusable, efficient, and maintainable
2. Data Integration
Integrate data from various sources, including transactional flows
Handle complex data scenarios such as:
Event sequencing (e.g. bet → resolve)
Idempotency and duplicate handling
Partial or delayed data
Ensure consistency between source systems and analytical datasets
3. Data Transformation & Modelling Support
Implement transformation logic aligned with architectural data models
Build and maintain structured data layers for analytics consumption
Collaborate closely with the Data Architect on model implementation
4. Data Quality, Monitoring & Reliability
Implement data validation, monitoring, and alerting mechanisms
Identify and resolve data inconsistencies or failures
Ensure high levels of data accuracy and availability
5. Performance & Scalability
Optimise pipelines for performance and cost-efficiency
Support scaling of data infrastructure as volumes grow
Ensure low-latency data availability where required
6. Collaboration
Work closely with Data Architect, Analysts, and Manager
Support Analysts by ensuring availability of curated datasets
Contribute to continuous improvement of data platform capabilities
Required Skills & Experience
3–7+ years experience in data engineering, backend engineering, or similar roles
Strong programming skills (e.g. Python, SQL)
Solid understanding of ETL/ELT processes and data pipeline design
Experience working with APIs and integrating distributed systems
Experience handling transactional or event-based data
Strong understanding of:
Data transformation techniques
Data warehousing concepts
Data modelling fundamentals
Experience with data orchestration and workflow tools
Ability to build robust, fault-tolerant systems
Strong problem-solving skills with attention to detail and data accuracy
Nice to Have
Experience in iGaming, fintech, or high-volume transactional environments
Experience with event streaming technologies (e.g. Kafka)
Familiarity with modern data stack tools (e.g. Snowflake, BigQuery, dbt, Airflow)
Experience with real-time or near real-time data processing
Understanding of idempotent processing and event ordering
Exposure to CI/CD and infrastructure-as-code practices
Experience supporting analytics or BI teams
Success Metrics
Reliability and uptime of data pipelines
Data freshness and latency
Reduction in data errors and inconsistencies
Performance and scalability of data processing
Availability of high-quality, curated datasets for analysts
What’s in it for you?
Experience a dynamic and team-orientated work environment.
Opportunities for personal growth and learning
An open, inclusive and supportive team where you will be valued, and your suggestions will be welcome.
26 days paid holiday per year. This is in addition to local bank holidays.
Competitive salary
€400 annual wellness Allowance
Hybrid Working
Risk Benefits such as pension, Life Assurance (4x annual salary),
Private Medical Insurance
Team Building Opportunities
Flexible core hours between 10am – 4pm
Receive support whenever you need it with our Employee Assistance Program, available 24/7.
Local discounts and more.
£90k - £100k per annum
...Unlock the potential of data as a Databricks Data Engineer in a permanent hybrid role that embraces innovation and collaboration. In this position, you will leverage Azure Databricks and work with Microsoft B.I to drive impactful data solutions. This role is ideal for individuals...SuggestedPermanentHybrid working- £64k - £84k per annumEstimated...order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers... .... Act as a technical bridge between the Market Data Engineering team, downstream consumers (trading, risk, compliance), and external...SuggestedImmediate start
£70k - £75k per annum
...to do it. AND WITH AI. An opportunity to get your hands down and dirty with data to help companies find the best talent. Specifically focusing on research, innovation, science and engineering. There is a huge and complex database,I am talking 2 million unique data points...SuggestedPermanent- £54k - £72k per annumEstimated...company is headquartered in London, with offices in Philadelphia, The Hague, Toronto, and Sydney. Role Overview The Data & Insight Engineer will build and own an AI-native analytics environment where insights are generated automatically from data rather than manually...SuggestedFull-timeHybrid workingOn-site
- £74k - £98k per annumEstimated...provides the Intelligence Fabric for Capital Markets, a trusted data network and intelligence architecture that transforms fragmented... ...AUM annually. The Opportunity: Rimes is looking for a Data Engineer to actively participate in building and modernising the data platform...SuggestedLong-term contract
£130k - £140k per annum
...Elevate your career as a Data Engineer in an innovative remote environment. We are seeking an experienced professional to design, implement, and maintain data solutions that drive insights and business value. Key Responsibilities and Skills: - Proficient in AWS and Google...PermanentRemote£50k - £60k per annum
...Databricks Data Engineer | Azure | Databricks | Git | CI/CD | FinTech | London Hybrid Working 2/3 days per week | £50,000-£60,000 + bonus + benefits Method Resourcing are proud to be partnered with a financial services organisation who specialise in both asset and wealth...Full-timeHybrid workingOn-site- £60k - £78k per annumEstimated...We're upgrading the foundation that captures algorithm decision data, moving from database logging to a versioned event stream with purpose... .... With the growing adoption of our Monte Carlo simulation engine, we can understand the impact of changes to our algorithmic underwriting...Full-time
- £59k - £78k per annumEstimated...Marketing, so people ship real code and launch custom dashboards in minutes. Engineering commits are entirely AI-assisted, which shifts the focus from team size to the quality of your thinking, and our data warehouse connects directly to an AI assistant for instant answers....Full-timeHybrid workingOn-siteShift work
- ...Citywire's data platform powers products across the company, both internal and external, from our industry ratings to our growing estate of production AI systems. We're hiring a Data Engineer to help build the pipelines and data models at the heart of it - taking requirements...Flexible hours
- £55k - £74k per annumEstimated...built to match the threat. Today, Ripjar's AI-native software and data fusion products are used by governments, the world's largest... ...from our office at any time. About the Role We see a Data Engineer as a software engineer who specialises in distributed data systems...Full-timeOn-siteRemote
- £53k - £68k per annumEstimated...growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and...Hybrid workingOn-site
- £42k - £56k per annumEstimated...Elevate your career as a Data Engineer in a role that marries technical prowess with innovative solutions. This permanent, hybrid position offers an exciting opportunity to work with SAS products within a collaborative environment. Your expertise will be instrumental in...PermanentHybrid working
- £59k - £76k per annumEstimated...independent assessment. You can learn more about Actis at . Key Purpose of Role General Atlantic is seeking an Associate-level Data Engineer to join the Data Strategy team. This role will report to the VP, Head of Data Engineering, and will work closely with senior data...Long-term contract
- £47k - £62k per annumEstimated...Google Role overview Given our exciting and progressive growth plans, we are looking for a skilled and experienced Senior Data Engineer to join our team. This role will report to the Head of Data & Infrastructure and play a key part in levelling up our infrastructure...On-siteRemote
- £51k - £66k per annumEstimated...Job Description Job Title: Data Engineer with AI knowledge - Associate Manager Salary: Competitive salary and package (Depending on level of experience) Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout the...
£50k per annum
...with Microsoft Fabric, Azure, SQL and PySpark. Join a growing data function where you'll have real ownership and influence. We’re... ...a significant data transformation and they’re looking for a Data Engineer to join their growing team. This is a hands-on Data Engineer role...PermanentOn-siteRemote- £48k - £62k per annumEstimated...The Data Engineer is responsible for building and maintaining scalable, reliable, and high-quality data pipelines and infrastructure that power data products and analytics across the organisation. The role focuses on ensuring data is accurate, timely, and consistently processed...Hybrid workingFlexible hours
- ...web, apps, social media, podcasts, email, YouTube, syndication partners and print. The role and the team We are looking for a Data Engineer to join our team. They will be responsible for maintaining and supporting the existing data infrastructure used to underpin our...
£50k - £70k per annum
...Unlock your potential as a Data Engineer in a flexible, remote role focused on leveraging Microsoft Business Intelligence. Our client is seeking a skilled Data Engineer to join their innovative environment. This permanent position invites you to make a meaningful impact...PermanentRemoteFlexible hours£50k - £65k per annum
...space. The company is scaling rapidly following recent growth, with data at the centre of how it drives performance, commercial outcomes... .... It’s a collaborative, ambitious environment that appeals to engineers who want ownership, variety and progression as the company continues...PermanentHybrid working- £48k - £63k per annumEstimated...need to outmanoeuvre the competition and are passionate about disrupting an established category Role Overview As a TSW data engineer you will be a key member of a dynamic media activation team, and a critical part of our service delivery to clients. You will...Long-term contractFull-timeOn-siteRemote
- £56k - £74k per annumEstimatedData Engineer - Outside IR35 We are looking for data engineers with data analysis and engineering expertise. Skills: - Advanced SQL - for high-performance data transformation, exploration, and optimisation across large, complex datasets - Cloud-Based ETL & Data Warehousing...Full-timeOn-site
£350 - £365 per day
...An exciting media agency in London is looking for a Data Engineer to support a leading client, helping to build a new marketing data capability within Snowflake and enable reporting, analytics and measurement. ~ Based in London - fully in the office ~3 days per week...On-siteImmediate start3 days/week- £39k - £52k per annumEstimated...private sector to design and build products, platforms and services that genuinely make a difference to users. We’re looking for a Data Engineer who enjoys working with data, technology and users to solve real problems. Someone who is comfortable working in delivery teams,...
- £34k - £45k per annumEstimated...our clients transform their business, from strategy through implementation and business transformation. We are looking for a Data Engineer to join our excellent Data Solutions team in London. We implement data analytics platforms for our customers based on the Modern...On-site
£75k per annum
...ETL Data Engineer – Fintech To £75,000 + 10% no-cont pension, bonus and shares Remote with occasional travel to the London Office. Quant Capital is urgently looking for a Data Engineer to join our well-known Fintech50 client who produces software disrupting...On-siteImmediate startRemote- £42k - £57k per annumEstimated...organisations solve complex challenges through strategy, design, engineering, and delivery. We work closely with our clients to deliver... ...engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive...Full-timeFlexible hours
- £65k - £86k per annumEstimated...lay the foundations for further and sustained success. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact...Full-time
£50k - £70k per annum
...Unlock your potential as a Data Engineer in a permanent onsite role, where your expertise in MS Business Intelligence will play a crucial part in shaping data-driven decision-making. In this position, you will: - Utilize Microsoft Business Intelligence tools to design...Permanent
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- data engineer London
- principal information security engineer London
- data centre engineer London
- data analytics developer London
- python data application developer London
- big data developer London
- data engineer graduate London
- data engineer azure London
- principal data engineer London
- data center engineer London

