11 of 11 Permanent Apache Spark Jobs in Manchester

build and manage scalable data pipelines and data analytic solutions that support strategic, ad hoc, and AI-driven data analytics using technologies such as Apache Spark, Apache Flink, Unity Catalog, Apache Hive, Databricks, Apache Iceberg, and Delta Tables. Innovation and Research: Drive innovation by researching … building high-throughput, low-latency systems to support short- and long-running processes at scale. Hands-on experience with event-driven platforms like Apache Kafka, RabbitMQ, Apache Pulsar, and other messaging systems for system integrations and real-time data streaming. Strong background in processing large batch and streaming ...

build and manage scalable data pipelines and data analytic solutions that support strategic, ad hoc, and AI-driven data analytics using technologies such as Apache Spark, Apache Flink, Unity Catalog, Apache Hive, Databricks, Apache Iceberg, and Delta Tables. Innovation and Research: Drive innovation by researching … building high-throughput, low-latency systems to support short- and long-running processes at scale. Hands-on experience with event-driven platforms like Apache Kafka, RabbitMQ, Apache Pulsar, and other messaging systems for system integrations and real-time data streaming. Strong background in processing large batch and streaming ...

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

data lake houses and data mesh Strong understanding of best practice DataOps and MLOps Up-to-date understanding of various data engineering technologies including Apache Spark, Databricks and Hadoop Strong understanding of agile ways of working Up-to-date understanding of various programming languages including Python, Scala ...

Mastery: Demonstrated expert proficiency in Python and R, including hands-on experience with leading ML frameworks (Scikit-learn, PyTorch, Keras), data engineering tools (SQL, Spark), and cloud platforms (AWS, Azure, GCP). Deep experience in applied mathematics, statistical modeling, machine learning, and AI applications Production Impact: Successfully deployed multiple ...

Mastery: Demonstrated expert proficiency in Python and R, including hands-on experience with leading ML frameworks (Scikit-learn, PyTorch, Keras), data engineering tools (SQL, Spark), and cloud platforms (AWS, Azure, GCP). Deep experience in applied mathematics, statistical modeling, machine learning, and AI applications Production Impact: Successfully deployed multiple ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … Excellent verbal and written communication skills BS or MS degree in Computer Science or equivalent Experience in distributed computing frameworks like - Hive/Hadoop, Apache Spark Experience in developing Finance or HR related applications Experience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB ...

algorithms, model optimization, and deploying scalable solutions in cloud environments. Experience with version control (Git), Linux, Docker, and data engineering tools such as Hadoop, Spark, and Elasticsearch. Strong problem-solving, team collaboration, and communication skills. Business Development (either in a commercial environment or through 'selling your ideas') a plus ...

algorithms, model optimization, and deploying scalable solutions in cloud environments. Experience with version control (Git), Linux, Docker, and data engineering tools such as Hadoop, Spark, and Elasticsearch. Strong problem-solving, team collaboration, and communication skills. Business Development (either in a commercial environment or through 'selling your ideas') a plus ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...