76 to 100 of 100 Apache Jobs

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

remit being the delivery of a new state of the art platforms for a specific business area. The technical stack includes Java, Oracle, Spring, Apache Flink, Apache Kafka, Apache Ignite, Angular You will proactively influence design whilst also being Development Lead, promoting the highest software development standards. ...

optimise scalable data pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams …/7 Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion ...

models are always running, always accurate, and always improving. Key Responsibilities ML Pipeline Orchestration & Automation Own and extend Circadia’s ML pipeline orchestration using Apache Airflow, including training, evaluation, and deployment workflows. Build and maintain automated pipelines for model retraining, validation, and promotion across development, staging, and production environments. … closely related infrastructure role. Strong proficiency in Python for ML pipeline development, tooling, and automation. Hands-on experience with ML pipeline orchestration tools, particularly Apache Airflow. Experience with model registries and experiment tracking platforms (MLflow preferred). Experience deploying and operating ML workloads on AWS (Batch ...

Directory Services (Active Directory, LDAP, etc.) Windows and/or *nix environments Scripting (e.g. PowerShell, Python, Bash) Databases (Oracle, MSSQL, MySQL, PostgreSQL) Web technologies (Apache, IIS, etc.) DevOps and software development practices Application integration Reporting and data analysis ...

repair and reassembly of systems already in use. In doing so, they work on the most famous aircraft and helicopters; think of the Apache combat helicopter, the F-35 Lightning II (JSF), the Bombardier Dash 8 Q400 and the multipurpose NH90 maritime combat helicopter. Over de functie ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

white paper authorship. Our stack Agents: LangGraph with Pydantic-typed state, Claude via Vertex AI, Gemini for fast tagging Graph and data: Postgres plus Apache AGE today, with a Rust temporal graph database in active development as the long-term replacement Backend: FastAPI, Python 3.12, Pydantic everywhere Frontend: Next.js ...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role … looking for Software Developers with strong Python and data processing with Apache Spark responsible to lead the design, development, and operation of data-driven applications and pipelines in a collaborative Dev and DevOps environment. The role focuses on writing and improving application code while working closely with DevOps engineers ...

Data Engineer within GCP environments Hands-on experience with BigQuery, Dataflow and Spanner Strong programming capability in Python, Java or Scala Experience with Apache Beam/Dataflow and distributed processing frameworks Experience designing and managing ETL/ELT pipelines Solid understanding of data modelling and database design Experience with … workflow orchestration tools such as Apache Airflow Strong understanding of data governance, security and scalability Desirable Skills for the GCP Data Engineer: Experience with Pub/Sub, Cloud Composer or Cloud Data Fusion Exposure to CI/CD, DevOps and Infrastructure as Code Experience with real-time streaming architectures ...

Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS). • Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark. • Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT. • Data Services: Familiarity with AWS Glue, Lake Formation ...

expand their Devops team (multiple roles). Key requirements: Strong experience with AWS services and infrastructure as code using Terraform Data engineering expertise using Apache Spark and Python, including development in Jupyter Notebooks Workflow orchestration and containerisation experience with Apache Airflow and Docker Version control and CI/ ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop … Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies We understand the usage ...

requirements 3+ years of Python in production environments Strong AWS experience across core services Strong SQL skills for querying, transformation, and optimisation Experience with Apache Spark or serverless architectures Core responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write … across large data volumes Model and transform data into well-structured, reusable datasets for downstream use Work with distributed data processing tools such as Apache Spark to handle high-volume workloads Improve existing pipelines by identifying bottlenecks and refactoring code and queries Develop and maintain data workflows, scheduling ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

legacy technologies. Migrate and refactor applications away from older stacks including: Python web frameworks PHP HTML/CSS/JavaScript (legacy implementations) Tomcat, Apache, MySQL Plone, FosWiki, and Kayako Target modern, sustainable architectures (e.g., contemporary Python frameworks such as Django or FastAPI, modern JavaScript frameworks like React … migrating legacy applications (PHP, older Python frameworks, Plone/FosWiki, or similar CMS/ticketing systems) to current architectures. Solid understanding of web servers (Apache/Tomcat), databases (MySQL/PostgreSQL), and deployment practices. Strong problem-solving skills and ability to work independently as well as collaboratively ...

operate the Event Hub platform that enables event-driven capabilities across the enterprise. In this role, you will own the underlying Confluent Kafka and Apache Flink infrastructure, ensuring it is production-grade, highly available, scalable, and resilient, with robust disaster recovery. Key Responsibilities Provision, configure, and manage Confluent Kafka … brokers, topics/partitions, ACLs, schema registry) and enforce platform governance standards (retention, quotas, security). Operate Apache Flink infrastructure (job/task managers, checkpointing, state backend) and support runtime availability and performance. Design and maintain high availability (AZ/region) and disaster recovery plans, including failover testing ...

Knowledge graph internals. Primary entity consolidation, edge criteria, enrichment agents that decide when to call web search vs. internal tools, and the Cypher/Apache AGE query layer underneath. Agent infrastructure. LangGraph pipelines, Pydantic-typed state, prompt caching, the eval harness that keeps it honest. Product surface. The Next.js … Vercel Backend: FastAPI, Python 3.12, Pydantic everywhere Agents: LangGraph, Claude via Vertex AI, Gemini for cheap/fast tagging work Data: Postgres + Apache AGE (graph), moving toward AlloyDB Omni on GKE where it fits Infra: GCP - GKE, Cloud Run, Cloud SQL, Vertex AI, KMS Tooling: pnpm, Husky commit ...

Data Engineer, working with large-scale, complex datasets in regulated environments Scala development experience supporting analytics or data-processing solutions Hands-on experience with Apache Spark for large-scale distributed data processing Experience with model calibration, threshold management, and score explainability to meet AML governance and regulatory standards Ability … Analyst or Data Engineer, working with large, complex datasets in regulated environments Solid Scala development experience, writing and supporting scalable data and analytics solutions Apache Spark experience, including batch and/or dynamic processing of high-volume data About Us FDM is an award-winning global leader in tech ...

Data Engineer, working with large-scale, complex datasets in regulated environments Scala development experience supporting analytics or data-processing solutions Hands-on experience with Apache Spark for large-scale distributed data processing Experience with model calibration, threshold management, and score explainability to meet AML governance and regulatory standards Ability … Analyst or Data Engineer, working with large, complex datasets in regulated environments Solid Scala development experience, writing and supporting scalable data and analytics solutions Apache Spark experience, including batch and/or dynamic processing of high-volume data About Us FDM is an award-winning global leader in tech ...