production issues. Optimize applications for performance and responsiveness. Stay Up to Date with Technology: Keep yourself and the team updated on the latest Python technologies, frameworks, and tools like Apache Spark, Databricks, Apache Pulsar, Apache Airflow, Temporal, and Apache Flink, sharing knowledge and suggesting improvements. Documentation: Contribute to clear and concise documentation for software, processes, and … Experience with cloud platforms like AWS, GCP, or Azure. DevOps Tools: Familiarity with containerization (Docker) and infrastructure automation tools like Terraform or Ansible. Real-time Data Streaming: Experience with Apache Pulsar or similar systems for real-time messaging and stream processing is a plus. Data Engineering: Experience with Apache Spark, Databricks, or similar big data platforms for processing … large datasets, building data pipelines, and machine learning workflows. Workflow Orchestration: Familiarity with tools like Apache Airflow or Temporal for managing workflows and scheduling jobs in distributed systems. Stream Processing: Experience with Apache Flink or other stream processing frameworks is a plus. Desired Skills Asynchronous Programming: Familiarity with asynchronous programming tools like Celery or asyncio. Frontend Knowledge: Exposure More ❯
in AWS. Strong expertise with AWS services, including Glue, Redshift, Data Catalog, and large-scale data storage solutions such as data lakes. Proficiency in ETL/ELT tools (e.g. Apache Spark, Airflow, dbt). Skilled in data processing languages such as Python, Java, and SQL. Strong knowledge of data warehousing, data lakes, and data lakehouse architectures. Excellent analytical and More ❯
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Fruition Group
best practices for data security and compliance. Collaborate with stakeholders and external partners. Skills & Experience: Strong experience with AWS data technologies (e.g., S3, Redshift, Lambda). Proficient in Python, Apache Spark, and SQL. Experience in data warehouse design and data migration projects. Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS More ❯
Newcastle Upon Tyne, Tyne and Wear, England, United Kingdom
Norton Rose Fulbright LLP
Azure/Microsoft Fabric/Data Factory) and modern data warehouse technologies (Databricks, Snowflake) Experience with database technologies such as RDBMS (SQL Server, Oracle) or NoSQL (MongoDB) Knowledge in Apache technologies such as Spark, Kafka and Airflow to build scalable and efficient data pipelines Ability to design, build, and deploy data solutions that explore, capture, transform, and utilize data More ❯
Jarrow, Tyne and Wear, North East, United Kingdom Hybrid / WFH Options
Catalyst
depth knowledge of relational databases (especially MS SQL) Also desirable use of Git/Azure Dev Ops, Visual Studio 2019/2022, JQuery, MS Power BI reporting, Linux/Apache web stack, bootstrap front end and sector experience in education Personal qualities: Passion for user experience, design and accessibility - commitment to diversity, inclusion and enabling people to achieve their More ❯
and user needs Qualifications 5+ years of hands-on experience with Python, Java and/or C++ Development of distributed systems Kubernetes (K8s) AWS (SQS, DynamoDB, EC2, S3, Lambda) Apache Spark Performance testing Bonus Search system development (indexing/runtime/crawling) MLOps development and/or operations The cash compensation range for this role is More ❯
wide range of technologies, such as Broadcom SSO ( formerly CA siteminder), CA federation, CA directory , Oracle DSEE/ODU, Oracle database, LDAP, IIS 7.x, Jboss and webservers such as apache and iplanet webserver. CHEF, IBM WebSphere application server, Inspec, Splunk, CA Wily. Sound knowledge in Identity and access management tools, IBM Security/Tivoli Access manager, IBM Security/ More ❯
wide range of technologies, such as Broadcom SSO ( formerly CA siteminder), CA federation, CA directory , Oracle DSEE/ODU, Oracle database, LDAP, IIS 7.x, Jboss and webservers such as apache and iplanet webserver. CHEF, IBM WebSphere application server, Inspec, Splunk, CA Wily. Sound knowledge in Identity and access management tools, IBM Security/Tivoli Access manager, IBM Security/ More ❯
Manchester, North West, United Kingdom Hybrid / WFH Options
OpenSourced Ltd
Develop, maintain, and optimise web applications using Laravel and Vue.js Build and customise WordPress themes and plugins , including WooCommerce integration Manage cloud deployments (AWS/DigitalOcean) and server configuration (Apache/Nginx) Maintain version control and CI/CD pipelines using GitHub workflows Create responsive, interactive user interfaces with modern JavaScript frameworks Design and maintain relational databases ( MySQL/ More ❯
able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data modelling - Experience managing Data Migration projects. - Cloud data platform development and … the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of More ❯
What Youll Need to Succeed Proven leadership as Head of IT, CTO, or senior technical leader in tech-driven or scaling businesses Deep knowledge of: PHP 8+, MySQL 8, Apache 2.4, Redis AI/ML tools (speech/NLP, automation, prediction engines) Cloud infrastructure (preferably AWS) Cybersecurity best practices, disaster recovery, and penetration testing Demonstrated success in modernising platforms More ❯
across teams What You’ll Need to Succeed Proven leadership as Head of IT, CTO, or senior technology leader in scaling businesses Deep knowledge of: PHP 8+, MySQL 8, Apache 2.4, Redis AI/ML tools (speech/NLP, automation, prediction engines) Cloud infrastructure (AWS preferred) Cybersecurity best practices, disaster recovery, penetration testing Demonstrated success in modernising platforms, optimising More ❯
clearly across teams What Youll Need to Succeed Proven leadership as Head of IT, CTO, or senior technology leader in scaling businesses Deep knowledge of: PHP 8+, MySQL 8, Apache 2.4, Redis AI/ML tools (speech/NLP, automation, prediction engines) Cloud infrastructure (AWS preferred) Cybersecurity best practices, disaster recovery, penetration testing Demonstrated success in modernising platforms, optimising More ❯
to our UK defence customers including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase.Boeing Defence UK engineering function operates a matrix organisation consisting of engineering departments that deliver More ❯
Contract Senior Data Engineer (OUTSIDE IR35) - Databricks/Apache Spark NEW CONTRACT VACANCY AVAILABLE - HYBRID NORTH WEST Contract position available for UK-based candidates UK-Based organisation - 2 days on-site in the North West Contract Senior Data Engineer 3 months (extensions likely) Outside IR35 Day rate: £450-500 To apply please email WHO ARE WE? We are one … WILL YOU BE DOING? As a Senior Data Engineer, you will be responsible for designing, developing and optimizing real time streaming data platforms. You will be highly experienced with Apache Spark and Databricks and will have used these in your most recent roles. As a Senior, you will play a key figure in taking control and leading the project. … You will need to be in our North West office twice per week. WE NEED YOU TO HAVE... Databricks Apache Spark Databricks certified (preferable) TO BE CONSIDERED... Please either apply by clicking online or emailing me directly to james.gambino @searcability.com By applying for this role, you give express consent for us to process & submit (subject to required skills) your More ❯