1 to 25 of 26 Permanent Apache Jobs in the North of England

efficient code, ensuring adherence to best practices through code reviews Big Data Engineering Design, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache Airflow Optimise data storage, retrieval, and processing systems to ensure reliability, scalability, and performance Develop and fine-tune complex queries using … Apache Spark for large-scale datasets Monitor, troubleshoot, and improve data systems to minimise downtime and maximise efficiency Collaboration & Mentorship Partner with analytics, software engineering, and other teams to deliver integrated, high-quality solutions Provide technical guidance and mentorship to junior engineers, promoting best practices in software and data ...

Apache Spark Python AWS Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

volume, data-intensive environments. Extensive AWS experience including services such as Glue, Lambda, S3, Redshift, and wider cloud-native data tooling. Strong knowledge of Apache Spark and large-scale data processing. Experience working with streaming technologies such as Kafka. Expert SQL and data modelling capabilities. Experience designing modern data ...

/ML Familiarity with Microsoft Fabric (Data Engineering, Data Science, Real-Time Analytics) and Azure ML, including MLflow Proficiency with tools such as Apache Spark, Azure Data Factory, GIT, Python and SQL Skilled in developing, training and deploying machine learning models with frameworks like TensorFlow, PyTorch or Scikit-learn ...

platform and lakehouse transformation journeys What We're Looking For Strong commercial experience in Data Engineering Hands-on experience with Databricks and/or Apache Spark Strong PySpark and SQL development skills Experience designing, building and supporting data pipelines Experience working with Azure or AWS Good understanding of modern ...

concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise• Observability – Experience ...

Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote.You’ll build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Delta Live Tables (DLT), and Kafka (MSK), ensuring our business teams across Liquidity, Product, Marketing, Finance, and Compliance have fast, trusted … looking for:We’re looking for an experienced Data Engineer with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark or Scala, including Structured Streaming. You should have experience with Kafka (MSK) and real-time data ingestion, as well ...

configuration management and an interest in migrating to Ansible and cloud native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

strong understanding of modern data engineering best practicesYou have experience with Databricks, ideally also AzureYou have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and PandasYou're excited to join a start-up in a role that you can shape and influenceYou ...

experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience with Azure ...

Upgrades and Support Package Stack patchingSystem copies & refreshesLog and trace file analysisSolution ManagerHANA Database AdministrationDesirable but not essential: Installation Performance analysisWeb Dispatcher, SAP Router, Apache administration skillsSSL/TLS knowledgeCloud Connector install and configSSO/IAMKnowledge of SAP/HANA/Oracle HA and DR set upBackup & RecoverySAP Cloud ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

make improvements for the long-term. Docker Java/Scala Event streaming technologies such as Kafka, Pulsar, or Azure Event Hub Integration with Collibra Apache Iceberg Apache Arrow Pyspark AI engineering (Snowflake AI, Langchain, Llamaindex, Pinecone, etc) Insight is committed to being an inclusive employer and encourages applications ...

needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking … experience with TerraformExperience in creating workflows for Apache Airflow#LI-GL1What's Roku's approach to hybrid working Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

software development team Hands-on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands-on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross-functional … highly scalable data engineering solutions that power Moody's next generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody's technical teams ...

ESXi, Windows 11, Ubuntu LTS, Dell PowerEdge, HP ProLiant, NetApp, Palo Alto, SonicWall, Check Point, UniFi, Aruba, Veeam, Bitdefender, PRTG, SQL Server, MySQL, IIS, Apache, WSUS, and related technologies. Desirable ITIL Foundation. Microsoft certifications. VMware experience. Exposure to cybersecurity, SIEM, and MDR solutions. This is an excellent opportunity ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

/Hibernate.Proven experience designing and scaling RESTful APIs.Solid understanding of MySQL (or other major RDBMS) with query-tuning experience.Hands-on experience with Apache Kafka and change data capture (CDC) pipelines.Proficient in Java performance profiling and debugging.Comfortable in Linux environments, with strong communication and production-support skills.PLUSESPlease note that these … build automations.Experience with service-oriented architecture and multi-tier server applications.Exposure to Caching Systems, Spring Cloud, Swagger.Experience with data warehousing solutions like Snowflake/Apache Doris.Familiarity with Debezium.HOW TO APPLYPlease apply with a CV and cover letter demonstrating how you meet the skills above. If we would like ...

Hibernate. Proven experience designing and scaling RESTful APIs. Solid understanding of MySQL (or other major RDBMS) with query-tuning experience. Hands-on experience with Apache Kafka and change data capture (CDC) pipelines. Proficient in Java performance profiling and debugging. Comfortable in Linux environments, with strong communication and production-support … with service-oriented architecture and multi-tier server applications. Exposure to Caching Systems, Spring Cloud, Swagger. Experience with data warehousing solutions like Snowflake/Apache Doris. Familiarity with Debezium. HOW TO APPLYPlease apply with a CV and cover letter demonstrating how you meet the skills above. If we would ...

Apache Associates are currently working with an innovative SaaS organisation that is investing heavily in AI across its products. We’re looking for an AI Software Engineer with strong C# .NET experience to join the team and help turn emerging AI capabilities into genuine, production-ready product features. This … wants to work somewhere that is genuinely putting AI into production, we'd be very interested in hearing from you. Apply now or contact Apache Associates for a confidential discussion. ...

Apache Associates are currently working with an innovative SaaS organisation that is investing heavily in AI across its products. We’re looking for an AI Software Engineer with strong C# .NET experience to join the team and help turn emerging AI capabilities into genuine, production-ready product features. This … wants to work somewhere that is genuinely putting AI into production, we'd be very interested in hearing from you. Apply now or contact Apache Associates for a confidential discussion. ...

Apache Associates are working with an ambitious SaaS organisation that is investing heavily in AI across its products and engineering function. We’re looking for a Senior Applied AI Engineer to take a leading role in turning AI capabilities into genuinely useful, production-ready solutions. This is a senior … with LLMs in the real world – while helping other engineers do the same – we'd love to hear from you. Apply now or contact Apache Associates for a confidential discussion. ...