17 Apache Jobs in East London

week, have a valid visa as we Are not able to sponsorTechnical Stack:- Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow Skillsyears of experience in python scripting.in developing applications in Python language.to python-oriented Algorithm’s libraries such as NumPy, pandas, beautiful soup, Selenium more »

to production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool more »

Processing: Work with Hadoop, Spark, and other platforms for large-scale data processing.Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark.Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL.Data Governance: Ensure data quality, security, and compliance with best practices.Ideal Candidate:Significant experience in more »

like Lambdas, step functions and ECS services.Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services.Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT.Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR more »

given requirement.Ensure to develop unit test cases.Help in backlog grooming.Key skills: Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache SparkExpertise in performing complex data transformation using Spark SQL queriesExperience in orchestrating data pipelines using Apache AirflowProficiency in Git based version control toolsProficiency more »

and maintaining ETL pipelinesKnow your way around Unix based operating systemExperience working with any major cloud provider (AWS, GCP, Azure)Fluency in EnglishExperience using Apache AirflowExperience using DockerExperience using Apache SparkBenefits:Salary £40-50K per annum dependant on skills and experience25 Days annual leave + Public HolidaysEarly more »

s Degree in Computer Science, Engineering (or other related STEM subject)5+ years experience in data engineering2+ years in a leadership role.Experience working with Apache Spark, Azure Data Factory and other data pipelines tools.Strong programming skills.Impeccable communication skills.Precise attention to detail.Pioneering attitude.If you are a Lead Data Engineer and more »

in cloud development (ideally AWS)Knowledge and ideally hands-on experience with data streaming, event-based architectures and KafkaStrong communication and interpersonal skillsExperience with Apache Spark or Apache Flink would be ideal, but not essentialPlease note, this role is unable to provide sponsorship.If this role sounds of interest more »

Job DescriptionLead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they require a very senior candidate … Responsibilities: Leading data engineering practicesSupport current applications Introduce AI practices to the team/project Communicate key successes with stakeholders Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full … UK without sponsorship, if you are interested please apply or email me directly - aaron.dhammi@nicollcurtin.comLead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based more »

stakeholdersWillingness to pick up and learn new technologies and frameworksNice to have:Knowledge of databases, SQLFamiliarity with Boost ASIOFamiliarity with data serialization formats such Apache Arrow/Parquet, Google Protocol Buffers, FlatbuffersExperience with gRPC, http/REST and Websocket protocolsExperience with Google Cloud/AWS and/or containerization more »

expertise in developing and optimising ETL pipelines.Version Control: Experience with Git for code collaboration and change tracking.Data Pipeline Tools: Proficiency with tools such as Apache Airflow.Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP.Visualisation: Tableau or PowerBIDelivery Tools: Familiarity with agile backlogs, code repositories, automated builds, testing, and releases. more »

Prometheus).Experience using Terraform/Docker/Kubernetes.Write software using either Java/Scala/Python.The following are nice to have, but not required -Apache Spark jobs and pipelines.Experience with any functional programming language.Database design concepts.Writing and analysing SQL queries.Application overVIOOHOur recruitment team will work hard to give you more »

to production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool more »

making, making trade-offs explicit and understandable to othersREQUIREMENTS7+ years' coding experience, including 3 years in a dedicated ML Engineering role2+ years’ experience with Apache SparkExperience working with GB+ scale dataExperience with deployed ML servicesExperience deploying multiple ML projects across different environmentsProductionisation experience in at least one cloud infrastructure more »

to use Java (for a very small amount of scripting work)Have public cloud experience with AWS or other cloud providersHave an understanding of Apache products such as Kafka and FlakeGood knowledge of development using CI/CDBonus points if you knowledge of:Web productsFinancial marketsThey are a very more »

around the Midlands.Ideal Candidate Profile: We are seeking an individual who have the following attributes:Proven expertise as a Data Engineer, demonstrating proficiency in Apache Spark and cloud-based technologies, particularly Microsoft Azure and Databricks. Strong programming skills, with a focus on Python, along with proficiency in ETL frameworks more »

successful Cloud Data Architect will likely have:Extensive cloud experience (Azure or AWS)Experience with streaming tools (preferably Kafka)Command of open-source languages (Apache, Python, Scala, Java, etc)Insurance experience (preferable)If you're interested, please apply now!Keywords: Analytics, Azure, AWS, Cloud, Data, Architecture, Scale, Java, Apache more »