1 to 25 of 29 Apache Jobs in the South East

senior stakeholders Required Experience 10+ years' experience across Data Engineering or closely related data disciplines Strong hands-on Python development experience Strong PySpark/Apache Spark engineering experience Extensive hands-on experience with Databricks , including notebooks, jobs/workflows and Delta Lake Advanced SQL and relational database experience Strong ...

Data Engineering. Strong commercial experience with Python. Advanced hands-on knowledge of Databricks, including notebooks, workflows, jobs, and Delta Lake. Strong experience with Apache Spark/PySpark. Proven track record building and maintaining scalable ETL pipelines. Strong SQL and data modelling expertise. Experience working within AWS, Azure ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools ...

critical data ecosystem while supporting the delivery of high-value data products. Key Responsibilities Design, build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimise batch and streaming data workflows, ensuring reliability, scalability and performance. Contribute to the design and implementation of modern Lakehouse data ...

production problems and taking responsibility for critical infrastructure. Startup Mindset: Proactive, resourceful and comfortable taking ownership in a fast-moving engineering environment. Bonus : with Apache Airflow, real-time data platforms, AI/ML infrastructure, LLM agents, GPU infrastructure or financial-market systems. Benefits An Ambitious, Collaborative Culture: Join ...

Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will be joining … Work across Azure environments on the low side Support data engineering workloads within Kubernetes environments on the high side Develop and maintain workflows using Apache Airflow Work with Apache Spark for large-scale data processing Support the ongoing development and improvement of established data pipelines Help ensure data ...

help design and deliver cutting-edge data solutions for customers operating in some of the UK's most complex and challenging environments. Using Databricks, Apache Spark and cloud-native technologies, you’ll develop scalable Lakehouse architectures and production-grade data pipelines that enable organisations to trust, share and exploit … opportunity to grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data ...

Experience of working with MOD Accreditors; and Knowledge of Onsite/project tech stack includes but is not limited to Azure, AWS, Docker, Kubernetes, Apache (NiFi, Kafka), NodeJS, Typescript, MongoDB, AI, Machine Learning etc. Just as important are curiosity, strong problem solving ability, and the motivation to continuously improve ...

Infrastructure-as-Code using Terraform Work with containers, orchestration and troubleshooting Support Linux infrastructure and PostgreSQL Manage load balancers including AWS ALB, NGINX and Apache Troubleshoot infrastructure issues, including memory faults and server crashes Manage Active Directory, SSL certificates and secure communications Support networking across AWS, including VPCs, IGWs ...

cloud cost management. What we're looking for: Strong commercial experience as a Data Engineer working with Databricks in production. Excellent knowledge of Apache Spark, Delta Lake and Databricks Workflows. Strong Python and SQL skills. Understanding of Lakehouse architecture, ETL/ELT and distributed data processing. Databricks certification highly ...

develop scalable ETL/ELT data pipelines using Python and PySpark Build and maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support the implementation and optimisation of Apache Iceberg lakehouse architectures Develop and enhance … commercial experience as a Data Engineer within AWS Expertise in Python , SQL , and PySpark Hands-on experience with dbt Strong experience managing workflows with Apache Airflow Experience with Amazon Redshift Knowledge of modern data lakehouse architectures, including Apache Iceberg Experience with OpenSearch/Elasticsearch technologies Exposure to Knowledge ...

experience, conversion, and operational efficiency. What we are looking for Essential: · Demonstrable experience as a Full-Stack PHP Developer , with strong expertise across PHP, Apache/Ngnix , SQL, and Linux environments. · Proven experience developing and integrating RESTful APIs and third-party services, alongside deploying and managing applications within Cloud ...

experience, conversion, and operational efficiency.### What we are looking for### Essential:· Demonstrable experience as a Full-Stack PHP Developer, with strong expertise across PHP, Apache/Ngnix, SQL, and Linux environments.· Proven experience developing and integrating RESTful APIs and third-party services, alongside deploying and managing applications within Cloud ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security ...

based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search ...

Responsibilities: Design, build and enhance a secure, scalable and reliable Databricks platform Develop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta Lake Contribute to platform architecture, engineering standards and best practices across the data estate Work with Product, Analytics and Data Science teams … continuous improvement across the engineering team Job Requirements: Significant experience building and supporting scalable, production-grade data platforms Strong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQL Good understanding of cloud-based data engineering, ideally within Microsoft Azure environments Experience with Infrastructure as Code tools ...

Databricks Senior Data Engineer - London (Hybrid) - Up to £85,000 Databricks - Apache Spark - Delta Lake - Python - SQL - Azure We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly collaborative team where … progression within a growing technology business. Key Experience Required Proven experience as a Data Engineer within production environments. Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL. Experience building and supporting scalable ETL/ELT pipelines. Strong understanding of distributed data processing and data modelling. ...

Senior Data Engineer (Databricks) - London (Hybrid) - Up to £85,000 Databricks - Apache Spark - Delta Lake - Python - SQL - Azure We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly collaborative team where … progression within a growing technology business. Key Experience Required Proven experience as a Data Engineer within production environments. Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL. Experience building and supporting scalable ETL/ELT pipelines. Strong understanding of distributed data processing and data modelling. ...

Envitia is seeking a Senior Data Engineer to design and deliver cutting-edge data solutions for customers in the UK. Using Databricks, Apache Spark and cloud-native technologies, you’ll build scalable Lakehouse architectures and production-grade pipelines that enable organisations to trust and share data. You’ll take ...

/IP networking. Experience with Routing, Switching and Layer 7 Firewalls. Linux administration experience (CentOS and/or Ubuntu). Experience with Apache and MySQL. Strong fault-finding and troubleshooting skills. Excellent documentation and communication skills. An analytical mindset with the ability to work independently and within a team. ...

engineering capability. Key responsibilities: Providing Staff-level technical leadership across major data engineering and transformation initiatives. Remaining deeply hands-on with Python, PySpark and Apache Spark . Leading the modernisation and migration of large-scale data pipelines across AWS. Designing and challenging technical approaches across AWS Glue, Airflow … technical stakeholders and engineering teams to challenge existing thinking and drive technical improvements. What we're looking for Extensive hands-on Python, PySpark and Apache Spark expertise. Deep experience with AWS data engineering , particularly AWS Glue. Strong experience with Apache Airflow and complex data pipeline orchestration. Proven experience ...

follow up corrective actions Good knowledge of TCP/IP networking concepts including Routing, Switching, Firewalling, including Layer 7 firewalls Linux (CentOS/Ubuntu, Apache, MySQL) Project planning and delivery experience Asterisk/VoIP platforms Windows Server and VMware intermediate level experience Hardware and/or software systems development ...

quality and delivery speed Raising engineering standards and capability across multiple teams What we're looking for Deep hands-on Python/PySpark and Apache Spark expertise Strong AWS data engineering , particularly AWS Glue Strong Apache Airflow experience Experience delivering complex data transformation or modernisation programmes Strong software ...