Lead Observability & Data Architect / Engineer (SC / DV Cleared)
£53.4 - £62.7 per hourEstimated
Full-time
- From Big Data/ETL to Telemetry Pipelines: If you have built high-throughput streaming pipelines using Apache Kafka, Airflow, NiFi, or Spark, you already know how to route and transform complex data feeds at scale.
- From Enterprise Search to System Observability: If you have engineered core search, indexing, or sharding architectures using Apache Solr, Lucene, or OpenSearch, you possess the exact foundational knowledge needed to scale an enterprise Elasticsearch cluster.
- From Cloud Infrastructure to Monitoring Fabrics: If you are a seasoned Cloud or Infrastructure Architect specializing in secure Kubernetes orchestration, Terraform automation, and air-gapped system design, you can easily pivot to defining secure logging architectures. We are seeking an Enterprise Platform Architect or Senior Data Engineer to design and scale national-critical monitoring fabrics and data hubs. Whether your background is rooted in core Observability platforms (Opensearch/Elastic/Splunk/OpenTelemetry) or high-scale Data Engineering (Kafka, Python, Airflow, OpenSearch/Lucene), your core mission is the same: transforming billions of raw event logs into actionable, secure streaming telemetry.
- Should be able to build high-performance data pipelines to ingest, parse, and structure massive event telemetry across hybrid-cloud and air-gapped environments.
- Manage large-scale cluster deployments, designing optimized indexing, data life cycle policies, and schema mapping (such as ECS).
- Expertise in Elasticsearch/OpenSearch, Splunk, or Solr. Strong proficiency in building visualization dashboards (Kibana, Grafana) and managing telemetry collectors (OpenTelemetry/OTel, Beats, Prometheus).
- Experience in designing and scaling data pipelines for high-velocity telemetry. Essential expertise in Apache Kafka, Logstash, or streaming/orchestration frameworks (Airflow, Vector, Debezium).
- Hands-on experience architecting scalable, containerized solutions using Kubernetes (K8s), Docker, and infrastructure-as-code (Terraform/Ansible).
- Search & Indexing Engine Depth: Prior architecture experience with OpenSearch, Apache Solr, or Lucene core or Elasticsearch.
- Strong proficiency in Python, Rust, or Bash for automating log parsing, testing, and deployment workflows.
- A strong track record of engineering within highly regulated sectors (eg, MoD, Home Office, BAE, HMRC) with an active UK security clearance (SC/DV).
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Lead Observability & Data Architect / Engineer (SC / DV Cleared) in Glasgow vacancy
- £78k - £104k per annumEstimated...IT Data Infrastructure Architect - Vice President Morgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities,... ...decisions. Partner with enterprise architects, engineering teams, and SREs to align solutions with IT...SuggestedFull-timeHybrid workingOn-siteFlexible hours
£51.53k - £55.05k per annum
...Senior Data Engineer (Ref. A133) Full time/Permanent Predominantly Aberdeen City Campus, with visits to our Aberdeen Altens and Fraserburgh... ...an experienced Senior Data Engineer to help shape, build and lead the next generation of data and analytics services across the College...SuggestedPermanentFull-time- £51k - £68k per annumEstimated...Senior Data Engineer - AWS Location: Glasgow (Hybrid) | Practice Area : Technology & Engineering |... ...production-grade systems. Apply AWS Well-Architected Principles to ensure scalability, security, and resilience. Lead in the development of robust, tested, and fault...SuggestedPermanentHybrid workingOn-site
$37 per hour
...Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate...SuggestedHourly payPart-timeFreelanceHybrid workingRemote- ...Data Modeller - 6 Month Contract - Hybrid (Glasgow 2 days pw) - Inside IR35 You will... ...and performance * Collaborating with Data Engineers to ensure data pipelines and transformations... ...and ability to communicate data concepts clearly 3-7+ years' experience in data modelling...SuggestedFull-timeHybrid working
- £47k - £62k per annumEstimated...Sword is a leading provider of business technology solutions within... ...foundations across platforms, data, and business applications. We... ...achieving their goals. The Data Architect is responsible for defining... .... Ensure documentation is clear, structured, and accessible to...Flexible hours
£64.09k - £76.85k per annum
...networks and MQTT protocols. - A systematic, disciplined and analytical approach to problem solving SSE has a bold ambition - to be a leading energy company in a net zero world. We're investing around £10 million a day in homegrown energy to help power a cleaner, more secure...PermanentFull-timeFlexible hours£52k - £66k per annum
...to unlock value from Edrington’s consumer data by transforming it into actionable insight... ..., the Data Scientist - Consumer Data will lead advanced analytics and data science activity... ...across brands and markets Work with engineering and platform teams to shape scalable, reusable...Hybrid working£400 - £550 per day
...fully remote. The role requires a strong Digital Tracking Engineer / Web Analytics implementation specialist to audit, stabilise and... ...compliance in analytics platforms (especially GA4) WooCommerce / data layer implementation experience ( GTM4WP preferred). Ability...Immediate startRemote- £47k - £61k per annumEstimated...'re seeking someone to join our team as a Data Quality Metrics Specialist in the broader... ...skills. Ability to present complex issues clearly. Excellent verbal and written... ...putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity...Full-timeFlexible hours
- ...Django Developer (SC Cleared) 600-750 per day | Inside IR35 | Hybrid (Glasgow - 1 day per... ...Hunt are working in partnership with a leading UK government organisation to recruit an... ...standards, review practices and secure engineering patterns. Design and guide implementation...Daily payPermanentFull-timeTemporaryInterimHybrid working
- £73k - £93k per annumEstimated...building advanced cloud platforms that power data-driven decision making. At... ...your skills drive change. As a Senior Lead Software Engineer, Cloud Platform in the Corporate AI and... ...pipelines and workflows for platform observability and analytics. Champion adoption of...Long-term contractShift work
- ...in oracle development on PL/SQL, Oracle Forms/Reports (10g/11g), Data warehousing, Database 19g. 3. Must be good in writing Oracle Procedures... ...entity relationship diagrams. 7. Able to work with solution architect for solution design & documentation, Experience in performance...
£70k - £80k per annum
...experienced Oracle technical developer to join our client a market-leading manufacturing company. The purpose of the role is to assist the... ...including writing interfaces to and from source systems, ensuring data and accounting integrity are always maintained. You will also...PermanentTemporary- £37k - £49k per annumEstimated...Lead AI Engineer (Senior/Principal Consultant) Location: Glasgow (Hybrid) | Practice Area :... ...services sector. As a hands-on leader, you’ll architect AI solutions, embed them within... ...workflows enabling AI agents to interact with data sources and APIs using prompt...PermanentHybrid workingOn-site
- £50k - £65k per annumEstimated...Join Us as an AI Platform Engineer - Shape the Future of AI at Barclays... ...vulnerabilities, protect sensitive data, and ensure secure software... ...decisions/changes. They may also lead a number of specialists to... ...are expected to demonstrate a clear set of leadership behaviours to...Long-term contractPermanentFull-timeTemporaryHybrid working
- £44k - £56k per annumEstimated...motivated Distributed-Database Platform Engineer to join our enterprise computing data infrastructure team overseeing... ...future of our communities. This is a Lead Software Production Management &... ...Platform Engineering & Operations Architect, deploy, and manage large-scale...Full-timeHybrid workingFlexible hours
- £81k - £108k per annumEstimated...Job Description As a Lead Cloud Software Engineer at JPMorganChase within the Cloud Financial Management organization, you design and build modern... ...requires advanced engineering skills to develop scalable services, data pipelines, and automation that improve cloud efficiency,...Long-term contract
- £64k - £86k per annumEstimated...Regulatory Financial Control (ERFC)/Strategic Data team at JPMorganChase where we leverage... ...a talented and motivated Software/Data Engineer to join our team and contribute to our mission... ...data into actionable insights. As a Lead Software Engineer at JPMorgan Chase within...Long-term contract
- £52k - £66k per annumEstimated...as an experienced member of our Software Engineering team. As an Experienced Software Engineer... ...to design and deliver trusted market-leading technology products in a secure, stable,... ...they bank with us, strategizing on how big data can make our trading systems quicker,...
£70k - £80k per annum
...AI Software Engineer - Agentic and GenAI (LangGraph & CrewAI) Client: Global Financial - Banking & Investments Location: Glasgow Hybrid... ...is a must, and the ability to explain technical solutions in a clear way to the business. Previous experience working in the financial...Full-timeHybrid workingOn-site$36 per hour
...with project-based AI opportunities for leading tech companies, focused on testing, evaluating... ...may: Design original computational engineering problems that simulate real engineering... ...libraries; Document problem statements clearly and provide verified correct answers....Hourly payPermanentTemporaryPart-timeFreelance- £59k - £76k per annumEstimated...Role: Test Automation Engineer – Python & Coding experience required - (Must have the right to work in the UK) Location: Glasgow – 4 days onsite Start Date: July End Date: 31 st December 2026 Daily Rate: Inside IR35 Payroll provider – Rockford Payroll...Daily payFull-time
- £52k - £68k per annumEstimated...have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance,...Long-term contract
- £44k - £57k per annumEstimated...Sword is a leading provider of business technology solutions within... ...foundations across platforms, data, and business applications. We... ...valuable ways, we need hands-on engineers who can design and deliver... ...work with clients, consultants, architects, and specialists to shape requirements...Flexible hours
- £61k - £79k per annumEstimated...Data Science Expert – AI Content Specialist About The Role What... ...concepts and statistical results clearly and concisely in written form... ...language model evaluation or prompt engineering Why Join Us Work directly with industry-leading AI research teams and cutting-edge...Hourly payOngoing contractFreelanceRemoteFlexible hours
- ...Modernization (A+M) team as an AI Cloud Solution Engineer in Operation Technology to help build a... ...new cloud services to Morgan Stanley Architect new cloud solutions for new use cases... ...clients first, doing the right thing, leading with exceptional ideas, committing to diversity...Full-timeFlexible hours
- ...At Alignerr, we partner with the world's leading AI research labs — and we need sharp scientific... ...rigorously test AI performance Develop clear, step-by-step solutions with well-... ...comfortable working independently No prior AI or data annotation experience required Nice to...Hourly payOngoing contractFreelanceRemoteFlexible hours
- £53k - £71k per annumEstimated...re seeking someone to join our Data Protection team as an... ...Artificial Intelligence (AI) lead in Cyber to lead with the implementation... .... This is a Cyber Security Engineering position at Vice President level... ...and present information in a clear and concise manner to technology...Full-timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Observability & Data Architect / Engineer (SC / DV Cleared). Be the first to apply!
Related searches