NiFi Data Engineer (SC Cleared)
Temporary
Job Title: NiFi Data Engineer
Location: Hybrid (up to 3 days per week on-site, across offices in London & South England)
Contract Length: 8 Months (with scope to extend)
Start Date: September 2026
IR35: Outside
Interview Process: 1 Stage, MS Teams
Clearance Required Before Applying: SC (with eligibility for higher levels of clearance)
We are supporting a public sector client in hiring a NiFi Data Engineer to join a collaborative development team delivering a data Lakehouse architecture across both cloud and on-premises platforms.
This is a hands-on data engineering role working within Agile sprints across a full software development life cycle, building and maintaining data pipelines, developing data models and handling non-functional requirements including security, performance and metadata labelling. The successful candidate will work closely with engineers and architects to deliver robust, well-tested pipelines that support a modern Lakehouse architecture across AWS and on-premises environments.
This role suits a self-starting data engineer with experience in Lakehouse architectures, event-driven design and CI/CD-integrated development, who is comfortable picking up new technologies quickly and contributing from day one within a fast-paced, security-conscious environment.
Key Responsibilities
- Design, develop and maintain data pipelines within a Lakehouse architecture across cloud and on-premises platforms
- Develop data models to support pipeline design, ensuring alignment with broader architectural standards and business requirements
- Handle non-functional aspects of pipeline development including security controls, performance optimisation and metadata labelling
- Implement event sourcing, change data capture and event-driven architecture patterns within the data platform
- Develop unit and integration tests for data pipelines as part of a CI/CD-integrated software development life cycle
- Collaborate within an Agile development team across sprint planning, code review and iterative delivery
- Apply Java and Groovy within an object-oriented design approach to support pipeline development and tooling
Essential Skills & Requirements
- Proven experience building data pipelines within Lakehouse architectures across cloud or on-premises environments
- Must be a UK national with SC clearance held and eligibility & willingness to undertake DV clearance
- Experience with event sourcing, change data capture and event-driven architecture patterns
- Familiarity with Java and Groovy, with a solid understanding of object-oriented design principles
- Experience working within an SDLC with an integrated development team using CI/CD tooling including Git
Desirable Skills
- Hands-on experience with Apache NiFi for data pipeline development and orchestration
- AWS experience including familiarity with EMR, S3 and SQS
- Awareness of domain-driven design approaches and architecture
- Linux awareness and Scripting skills
- PostgreSQL and PL/SQL knowledge
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the NiFi Data Engineer (SC Cleared) in London vacancy
£70k - £75k per annum
...Senior Data Engineer (Azure Databricks) - SC Cleared Location: London, UK (3 days per week onsite) Salary: Up to £75,000 per annum Job Type: Permanent, Full-Time Security Clearance: Active SC Clearance Required The Opportunity We are seeking an experienced...SuggestedPermanentFull-timeHybrid workingOn-site- £59k - £78k per annumEstimatedSAS Data Engineer - SC Cleared We are looking for a SAS data engineer. You will have experience of developing, maintaining, and optimizing data pipelines using SAS (SAS Enterprise Guide, and SAS Viya). Required Skills: - Hands-on use of SAS Enterprise Guide for data manipulation...SuggestedRemote
- £83k - £107k per annumEstimated...From Big Data/ETL to Telemetry Pipelines: If you have built high-throughput... ...using Apache Kafka, Airflow, NiFi, or Spark, you already know how... ...Observability: If you have engineered core search, indexing, or... ...Office, BAE, HMRC) with an active UK security clearance (SC/DV)....SuggestedPermanentFull-timeHybrid working
£70k - £75k per annum
...We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling...SuggestedFull-time- £52k - £67k per annumEstimated...Role: Engineering Manager Contract: Permanent Salary: Competitive... ...UK security clearance (BPSS and SC). SC requires 5 years of continuous... ...layer that fuses multi-modal data, including text, imagery, telemetry... ...the person the team comes to. Clear blockers, resolve friction, and...SuggestedPermanentFull-timeHybrid workingFlexible hours
£300 - £400 per day
AI Automation Engineer - SC clearance required - London / Leeds - Hybrid 2/3 days per week onsite Exciting opportunity to join a leading finance house in either London or Leeds, you will have be able to demonstrate and evidence experience of delivering the below: Key criteria...Hybrid working£58k - £87k per annum
...than 30 years, we have been building the data foundations that make intelligent systems... ...What You'll Architect As a Market Data Engineer , you will help organisations transform complexity... ...can translate technical challenges into clear communication for non-engineering...Full-timeFixed-term contractHybrid workingOn-siteImmediate start- £51k - £66k per annumEstimated...Job Description Job Title: Data Engineer with AI knowledge - Associate Manager Salary: Competitive salary and package (Depending on level... ...a non-technical audience o Writing meaningfully to deliver clear information, and guidance o Giving impactful presentations,...
£10k per annum
...strategy through implementation, accelerated by data, digital and AI. We shape opinion... ...meaningful change. About the role The Data Engineer sits within the Data Innovation team and... ...to care delivery and policy ~ A clear communicator who knows when to ask for support...Long-term contractFull-timeApprenticeshipHybrid workingRemoteWork from homeFlexible hours- ...speed or rigour. What You’ll Do As a Data Analyst at Legl, you'll : Own... ...perfect inputs. You have real analytics-engineering craft, and you've done the hard parts. Strong... ...work as a matter of course, and you have a clear view on where AI should and shouldn't be trusted...
- £81k - £108k per annumEstimated...Smarkets is where you belong. The Team The Data Team is responsible for taking the wealth... ...across three different areas: ~Data Engineering: development and maintenance of ETL... ...will find an environment where you have a clear engineering direction, can focus on your work...Odd jobOn-siteWork from homeFlexible hours
- £55k - £72k per annumEstimated...depth of coverage across four core services: clearing, agency and execution, market making, and... ..., voice and DMA, plus award-winning data, insights and analytics. The Technology... ...technical bridge between the Market Data Engineering team, downstream consumers (trading, risk...Full-timeImmediate start
- £52k - £69k per annumEstimated...About the Position We are looking for a Data Engineer to turn messy, real-world datasets into reliable inputs for research and trading.... ...programming skills in any language (Python a plus); you write clear, correct, and maintainable code Proficient with SQL or DataFrame...Full-time
£350 - £400 per day
...Organic / LLM Optimisation ? Strategy & Data Consultancy ? In-housing support They... ...and pipeline stability ? Lack of clear data architecture and documentation ? Limited... ...Individual We are looking for a hands-on Data Engineer to help us transition from an early-stage...- £41k - £53k per annumEstimated...'s market leading telecommunications organisation to recruit a Data Engineer on a contract basis - Hybrid working - London / Hampshire based... ...Take full ownership of a core engineering workstream Produce clear documentation and BAU handover Profile The Data Engineer...Hybrid working
- £73k - £94k per annumEstimated...before it's ever at risk. Our mission: make data-driven, preventative care accessible to... ...healthier lives. ROLE PURPOSE As a Data Engineer within our Data-to-AI platform, you will... ...of the role are fully aligned and will be clearly discussed throughout the process....Full-timeOn-siteRemoteFlexible hours
- £59k - £76k per annumEstimated...Purpose of Role General Atlantic is seeking an Associate-level Data Engineer to join the Data Strategy team. This role will report to the VP... ...working collaboratively within cross-functional teams Clear written and verbal communication skills, with the ability to explain...Long-term contract
- £53k - £68k per annumEstimated...government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of... ...strong interpersonal skills You are security cleared or capable and willing to undergo security clearance...Hybrid workingOn-site
$115k - $125k per annum
...ABOUT THIS POSITION We are seeking a Principle Data Engineer with extensive experience in data infrastructure to join our team. Unlike... ...architectural standards are met. Communication: Ability to clearly communicate technical decisions, trade-offs, and infrastructure...Flexible hours- £58k - £74k per annumEstimated...days in the office Tues - Thurs The Role We are seeking a Data Engineer to join our Data Team, playing a vital part in building the... ...Experience with Airflow environment management and Docker You can clearly and concisely explain intricate technical concepts to both...Hybrid workingOn-siteFlexible hours
£58k - £87k per annum
...intelligence , helping organisations transform data, digital capabilities, and AI into... ...#OneTeamOneKeyrus The Role As a Senior Data Engineer, focused on Snowflake , you will work at... ...delivery. ~ Ability to communicate clearly with both technical and non-technical...PermanentFull-timeHybrid workingOn-site- £55k - £73k per annumEstimated...other benefits and privileges of employment. Title: Senior Data Engineer Job Type: Permanent Job Location: London, UK The Opportunity... .... Deep proficiency in Python, Spark, and Iceberg, with a clear understanding of data structuring for efficiency and...Remote jobPermanent
£111k - £145k per annum
...Description About the role We are looking for a passionate Senior Data Engineer II to join the Treasury Global Liquidity team and help design... ..., capable of articulating complex technical concepts clearly to both technical and non-technical audiences. Interested? Find...Full-timeHybrid working- £70k - £92k per annumEstimated...win business. Collaborators to build it. Data pros who turn numbers into insights. Product... ...it. Mission The Senior Data Engineer exists to build and scale the data infrastructure... ...runbooks, and best practices are written clearly enough that a new engineer can onboard to...Remote
- £60k - £79k per annumEstimatedPostgres Data Engineer - Outside IR35 / Remote We are looking for 3 to 4 Postgres data engineers from junior to senior level. You will have... ...as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of...Full-timeRemote
- ...generating vast quantities of aggregated market data. By applying AI and machine learning... ...footprint. The role: A Senior data engineer builds, maintains and supports our data... ...Communication Communicate effectively and clearly to those within your team and across the...
- ...About the Role We’re seeking a Senior Data Engineer to transform our analytics infrastructure from monolithic SQL/PostgreSQL systems into... ...Documentation Strong technical writing – please provide examples Clear presentation skills for technical and non-technical audiences...Long-term contractPermanentOn-siteRemoteFlexible hours
- £59k - £78k per annumEstimated...About the Position We are looking for an experienced Data Centre Engineer who can help our team keep Jane Street’s data safe and accessible around... ...always on the lookout for ways we can do things better A clear communicator with excellent people and project management...Full-timeRemoteWeekend workAfternoon shift
- ...Key Responsibilities You'll be joining a small, collaborative data engineering team and taking on real ownership of production-critical... ...engineering is practised at a data-first business, and to leave a clear mark on something that matters to the organisation. For the...Hybrid workingOn-siteRemoteFlexible hours
- £31k - £41k per annumEstimated...excellence and creativity. The role We are looking for a Data Engineer to join Sony Interactive Entertainment, where data plays a key... ...problem-solving skills and ability to handle multiple priorities Clear communication skills, including explaining technical concepts...Fixed-term contractOn-site
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to NiFi Data Engineer (SC Cleared). Be the first to apply!
Related searches
- data engineering lead London
- information developer London
- data engineering intern summer London
- data developer London
- principal information security engineer London
- data engineer graduate London
- data center engineer London
- principal data engineer London
- senior data engineer London
- remote data engineer London