Lead Observability & Data Architect / Engineer (SC / DV Cleared)
£53.4 - £62.7 per hourEstimated
Full-time
- From Big Data/ETL to Telemetry Pipelines: If you have built high-throughput streaming pipelines using Apache Kafka, Airflow, NiFi, or Spark, you already know how to route and transform complex data feeds at scale.
- From Enterprise Search to System Observability: If you have engineered core search, indexing, or sharding architectures using Apache Solr, Lucene, or OpenSearch, you possess the exact foundational knowledge needed to scale an enterprise Elasticsearch cluster.
- From Cloud Infrastructure to Monitoring Fabrics: If you are a seasoned Cloud or Infrastructure Architect specializing in secure Kubernetes orchestration, Terraform automation, and air-gapped system design, you can easily pivot to defining secure logging architectures. We are seeking an Enterprise Platform Architect or Senior Data Engineer to design and scale national-critical monitoring fabrics and data hubs. Whether your background is rooted in core Observability platforms (Opensearch/Elastic/Splunk/OpenTelemetry) or high-scale Data Engineering (Kafka, Python, Airflow, OpenSearch/Lucene), your core mission is the same: transforming billions of raw event logs into actionable, secure streaming telemetry.
- Should be able to build high-performance data pipelines to ingest, parse, and structure massive event telemetry across hybrid-cloud and air-gapped environments.
- Manage large-scale cluster deployments, designing optimized indexing, data life cycle policies, and schema mapping (such as ECS).
- Expertise in Elasticsearch/OpenSearch, Splunk, or Solr. Strong proficiency in building visualization dashboards (Kibana, Grafana) and managing telemetry collectors (OpenTelemetry/OTel, Beats, Prometheus).
- Experience in designing and scaling data pipelines for high-velocity telemetry. Essential expertise in Apache Kafka, Logstash, or streaming/orchestration frameworks (Airflow, Vector, Debezium).
- Hands-on experience architecting scalable, containerized solutions using Kubernetes (K8s), Docker, and infrastructure-as-code (Terraform/Ansible).
- Search & Indexing Engine Depth: Prior architecture experience with OpenSearch, Apache Solr, or Lucene core or Elasticsearch.
- Strong proficiency in Python, Rust, or Bash for automating log parsing, testing, and deployment workflows.
- A strong track record of engineering within highly regulated sectors (eg, MoD, Home Office, BAE, HMRC) with an active UK security clearance (SC/DV).
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Lead Observability & Data Architect / Engineer (SC / DV Cleared) in Glasgow vacancy
- £78k - £104k per annumEstimated...IT Data Infrastructure Architect - Vice President Morgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities,... ...decisions. Partner with enterprise architects, engineering teams, and SREs to align solutions with IT...SuggestedFull-timeHybrid workingOn-siteFlexible hours
£51.53k - £55.05k per annum
...Senior Data Engineer (Ref. A133) Full time/Permanent Predominantly Aberdeen City Campus, with visits to our Aberdeen Altens and Fraserburgh... ...an experienced Senior Data Engineer to help shape, build and lead the next generation of data and analytics services across the College...SuggestedPermanentFull-time- £56k - £75k per annumEstimated...Sword is a leading provider of business technology solutions within... ...foundations across platforms, data, and business applications. Our... ...About the role: This Data Engineer role offers an excellent... ...cross-functional teams (data architects, analysts, data scientists, product...SuggestedFlexible hours
- £53k - £69k per annumEstimated...Data Centre Engineer - Glasgow Location: Glasgow, United Kingdom Job Description: We are seeking a highly skilled Data Centre Engineer to join our team in Glasgow. The successful candidate will be responsible for maintaining and optimizing our data centre infrastructure...Suggested
- £57k - £76k per annumEstimated...Sword is a leading provider of business technology solutions within the Energy, Public... ...technical foundations across platforms, data, and business applications. Our mission is... ..., secure data architectures Lead data engineering and architecture across ingestion, storage...SuggestedFull-timeFlexible hours
$45 per hour
...Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll...Hourly payPart-timeFreelanceHybrid workingRemote- ...Data Modeller - 6 Month Contract - Hybrid (Glasgow 2 days pw) - Inside IR35 You will be... ...and performance * Collaborating with Data Engineers to ensure data pipelines and... ...and ability to communicate data concepts clearly 3-7+ years' experience in data modelling...Full-timeHybrid working
- ...Technology and Services industry is looking for a SQL Production Engineer to provide production support for enterprise applications... ...ITIL best practices. Monitor production environments using observability and application performance monitoring tools. Support ServiceNow...Hybrid workingOn-siteRemoteFlexible hours
- £60k - £78k per annumEstimated...Description Role Overview As a Software Engineer III at JPMorganChase within the AI/ML... ...issues across application, API, data-access, and runtime layers Implement LLM... ...operability of services by adding and using observability tooling including logs, metrics, traces,...Long-term contract
- £47k - £61k per annumEstimated...'re seeking someone to join our team as a Data Quality Metrics Specialist in the broader... ...skills. Ability to present complex issues clearly. Excellent verbal and written... ...putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity...Full-timeFlexible hours
- £66k - £88k per annumEstimated...Description Are you a senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is... ...stacks. As a Senior Lead Software Engineer at JPMorganChase... ...automated testing, code reviews, observability, and resilient, secure service design...Long-term contract
- £73k - £93k per annumEstimated...building advanced cloud platforms that power data-driven decision making. At... ...your skills drive change. As a Senior Lead Software Engineer, Cloud Platform in the Corporate AI and... ...pipelines and workflows for platform observability and analytics. Champion adoption of...Long-term contractShift work
£70k - £80k per annum
...experienced Oracle technical developer to join our client a market-leading manufacturing company. The purpose of the role is to assist the... ...including writing interfaces to and from source systems, ensuring data and accounting integrity are always maintained. You will also...PermanentTemporary- £55k - £73k per annumEstimated...Developer to join our growing engineering team. The successful candidate... ...-grade applications and data solutions. You will work across... ...lifecycle, collaborating with architects, developers, DevOps engineers,... ...problem-solving abilities. Clear communication skills. Ability...Full-timeOn-site
- £50k - £65k per annumEstimated...Join Us as an AI Platform Engineer - Shape the Future of AI at Barclays... ...vulnerabilities, protect sensitive data, and ensure secure software... ...decisions/changes. They may also lead a number of specialists to... ...are expected to demonstrate a clear set of leadership behaviours to...Long-term contractPermanentFull-timeTemporaryHybrid working
- £49k - £64k per annumEstimated...opportunity for you to take your software engineering career to the next level. At... ...diverse, agile team to deliver trusted, market-leading technology products in a secure, stable,... ...visualizations and reporting from large, diverse data sets in service of continuous improvement...Long-term contract
- £44k - £56k per annumEstimated...motivated Distributed-Database Platform Engineer to join our enterprise computing data infrastructure team overseeing... ...future of our communities. This is a Lead Software Production Management &... ...Platform Engineering & Operations Architect, deploy, and manage large-scale...Full-timeHybrid workingFlexible hours
$200 per hour
...connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and... ...evaluation is fair and robust What this is NOT: Not data labeling Not prompt engineering Not writing code from scratch - the agent writes most...PermanentTemporaryPart-timeFreelance- £76k - £101k per annumEstimated...Job Description As a Lead Software Engineer in Credit Technology at JPMorgan Chase, you will join an... ...office solutions that power trading, ref data management, and P&L. You will design,... ...Translate evolving business demands into clear technical requirements and pragmatic solutions...Long-term contract
- £60k - £77k per annumEstimated...opportunity for you to take your software engineering career to the next level. As a... ...III at JPMorganChase within the AI/ML and Data Platform, you serve as a seasoned member... ...team to design and deliver trusted market-leading technology products in a secure, stable,...Long-term contract
- £75k - £98k per annumEstimated...adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase in the Athena Core DevTools team, you will... ...of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs...Long-term contract
$75 per hour
...with project-based AI opportunities for leading tech companies, focused on testing, evaluating... ...: scope creep, policy violations, data corruption, over-permissive changes Write... ...NOT: Not data labeling; Not prompt engineering; Not cybersecurity or red-teaming — there...Hourly payPermanentTemporaryPart-timeFreelance£70k - £90k per annum
...OpenAI and NVIDIA (among others) enables us to lead the industry in building valuable,... ...About the role Applied AI solution engineers are expected to work in small teams of Tomoro... ...development, including considerations for data privacy, bias minimization, and regulatory...Full-timeHybrid workingFlexible hours- £42k - £56k per annumEstimated...Sword is a leading provider of business technology solutions within... ...foundations across platforms, data, and business applications. We... ...valuable ways, we need hands-on engineers who can design and deliver... ...work with clients, consultants, architects, and specialists to shape requirements...Flexible hours
- £61k - £79k per annumEstimated...Data Science Expert – AI Content Specialist About The Role What... ...concepts and statistical results clearly and concisely in written form... ...language model evaluation or prompt engineering Why Join Us Work directly with industry-leading AI research teams and cutting-edge...Hourly payOngoing contractFreelanceRemoteFlexible hours
- ...At Alignerr, we partner with the world's leading AI research labs — and we need sharp scientific... ...rigorously test AI performance Develop clear, step-by-step solutions with well-... ...comfortable working independently No prior AI or data annotation experience required Nice to...Hourly payOngoing contractFreelanceRemoteFlexible hours
- £53k - £71k per annumEstimated...re seeking someone to join our Data Protection team as an... ...Artificial Intelligence (AI) lead in Cyber to lead with the implementation... .... This is a Cyber Security Engineering position at Vice President level... ...and present information in a clear and concise manner to technology...Full-timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Observability & Data Architect / Engineer (SC / DV Cleared). Be the first to apply!
