Permanent Apache Spark Jobs in Lancashire

18 of 18 Permanent Apache Spark Jobs in Lancashire

DataOps Engineer-1

Manchester, Lancashire, United Kingdom
Hybrid / WFH Options
Smart DCC
you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools. Optimize batch processing workflows with tools like Apache Spark and Flink for scalable performance. Infrastructure Automation: Implement … Integrate cloud-based data services with data lakes and warehouses. Build and automate CI/CD pipelines with Jenkins, GitLab CI/CD, or Apache Airflow. Develop automated test suites for data pipelines, ensuring data quality and transformation integrity. Monitoring & Performance Optimization: Monitor data pipelines with tools like Prometheus More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Engineer

blackpool, north west england, United Kingdom
Hybrid / WFH Options
Perch Group
problem-solving skills Strong teamwork, interpersonal and collaboration skills with colleagues and clients Desirable: Experience with Cloud ETL tools such as Databricks/Snowflake, Spark and Kafka Experience using source control tools such as GitHub or Azure DevOps Experience with Azure DevOps for CI/CD pipeline development and More ❯
Posted:

Senior Data Engineer

preston, lancashire, north west england, United Kingdom
Hybrid / WFH Options
Perch Group
problem-solving skills Strong teamwork, interpersonal and collaboration skills with colleagues and clients Desirable: Experience with Cloud ETL tools such as Databricks/Snowflake, Spark and Kafka Experience using source control tools such as GitHub or Azure DevOps Experience with Azure DevOps for CI/CD pipeline development and More ❯
Posted:

Data Engineer

preston, lancashire, north west england, united kingdom
Hybrid / WFH Options
The Citation Group
Understanding of cloud computing security concepts Experience in relational cloud-based database technologies like Snowflake, BigQuery or Redshift Experience in open-source technologies like Spark, Kafka, Beam understanding of Cloud tools such as AWS, Microsoft Azure or Google Cloud Familiarity with DBT, Delta Lake, Databricks Experience working in an More ❯
Posted:

Senior Data Analytics Sales Consultant

preston, lancashire, north west england, United Kingdom
Catch Resource Management
salesforce, hubspot, SaaS, data lakes, apis, adtech, GDPR, CCPA, B2B, Sales Consultant, Account Manager, DataOps, CICD, DevOPs, CI/CD, GenAI, RAG, AWS, Azure, Apache, Spark, Kafka – UK Wide - £80,000-£95,000 + OTE Our large Microsoft Partner client requires a Senior Data Analytics Sales Consultant to More ❯
Posted:

Software Engineer

preston, lancashire, north west england, United Kingdom
OptumUK
your cloud/platform engineering capabilities Experience working with Big Data Experience of data storage technologies: Delta Lake, Iceberg, Hudi Knowledge and understanding of Apache Spark, Databricks or Hadoop Ability to take business requirements and translate these into tech specifications Competence in evaluating and selecting development tools and More ❯
Posted:

MTS 1, Software Engineer

Manchester, Lancashire, United Kingdom
eBay Inc
into software language such as Java or Python; web-development skills and middlewares like Springboot, database, caches; and Bigdata tech stack as Hadoop/Spark/Flink/Kafka Clean coding habits, attention to detail, focus on quality and best practice. Good oral and written communication in English. Experience More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Artificial Intelligence Engineer

preston, lancashire, north west england, United Kingdom
Hybrid / WFH Options
X4 Technology
with experience in AI frameworks (e.g., TensorFlow, PyTorch, Keras). Strong knowledge of data analysis, visualisation tools, and big data technologies (e.g., SQL, Hadoop, Spark). Experience with machine learning techniques, including NLP, recommendation algorithms, and computer vision. Familiarity with cloud platforms (Azure) for deploying AI solutions . Strong More ❯
Posted:

Application Support Engineer

preston, lancashire, north west england, United Kingdom
Hybrid / WFH Options
Algo Capital Group
tools and alerting frameworks SQL experience including queries/updates/table creation/basic database maintenance Exposure to data technologies such as Kafka, Spark or Delta Lake is useful but not mandat Bachelor's degree in Computer Science, Engineering, or related technical field This role offers competitive compensation More ❯
Posted:

Senior Research Data Scientist

Manchester, Lancashire, United Kingdom
Up Closets of North Cincinnati
s degree/PhD in Computer Science, Machine Learning, Applied Statistics, Physics, Engineering or related field Strong mathematical and statistical skills Experience with Python, Spark and SQL Experience implementing and validating a range of machine learning and optimization techniques Effective scientific communication for varied audiences Autonomy and ownership of More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Research Data Scientist

Manchester, Lancashire, United Kingdom
ENGINEERINGUK
s degree/PhD in Computer Science, Machine Learning, Applied Statistics, Physics, Engineering or related field Strong mathematical and statistical skills Experience with Python, Spark, and SQL Experience implementing and validating a range of machine learning and optimization techniques Effective scientific communication for varied audiences Autonomy and ownership of More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Cloud Data Engineer

Manchester, Lancashire, United Kingdom
Hybrid / WFH Options
Qodea
GCP). Proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle. Experience with big data technologies such as Hadoop, Spark, or Hive. Familiarity with data warehousing and ETL tools such as Amazon Redshift, Google BigQuery, or Apache Airflow. Proficiency in at least one More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Software Engineer - Back End (Bangkok based, Relocation provided)

Manchester, Lancashire, United Kingdom
Agoda
Our systems are self-healing, responding gracefully to extreme loads or unexpected input. We use modern languages like Kotlin and Scala, Data technologies Kafka, Spark, MLflow, Kubeflow, VastStorage, StarRocks and agile development practices. Most importantly, we hire great people from around the world and empower them to be successful. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Kubernetes Specialist / SME

preston, lancashire, north west england, United Kingdom
TEC Partners - Technical Recruitment Specialists
and migrating a host of applications suites to a Kubernetes infrastructure environment. Requirements: Kubernetes implementation, Kubernetes-specific architecture, hands-on migration work, Kubernetes Security Spark S3 Engine Terraform Ansible CI/CD Hadoop Linux/RHEL – on prem background/container management Grafana or Elastic Search– for observability Desirable More ❯
Posted:

Senior Software Engineer - Java Microservices

Manchester, Lancashire, United Kingdom
Roku, Inc
object-oriented design principles, and data structures Extensive experience in developing microservices using Java, Python Experience in distributed computing frameworks like - Hive/Hadoop, Apache Spark. Good experience in Test driven development and automating test cases using Java/Python Experience in SQL/NoSQL (Oracle, Cassandra) database design … following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, Lambda Working experience with Terraform Experience in creating workflows for Apache Airflow About Roku Roku pioneered streaming to the TV. We connect users to the streaming content they love, enable content publishers to build and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior BI Developer

Bolton, Lancashire, United Kingdom
ao.com
As a Senior BI Developer, you will be at the forefront of creating Analytical Solutions and insights into a wide range of business processes throughout the organisation and playing a core role in our strategic initiatives to enhance data-driven More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scientist - PwC Visa Sponsorship Available

Manchester, Lancashire, United Kingdom
HipHopTune Media
to join its innovative team. This role requires hands-on experience with machine learning techniques and proficiency in data manipulation libraries such as Pandas, Spark, and SQL. As a Data Scientist at PwC, you will work on cutting-edge projects, using data to drive strategic insights and business decisions. … e.g. Sklearn) and (Deep learning frameworks such as Pytorch and Tensorflow). Understanding of machine learning techniques. Experience with data manipulation libraries (e.g. Pandas, Spark, SQL). Git for version control. Cloud experience (we use Azure/GCP/AWS). Skills we'd also like to hear about More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Backend Engineer - Content and Contributor Intelligence (Remote - United Kingdom)

Manchester, Lancashire, United Kingdom
Hybrid / WFH Options
Yelp USA
Summary Yelp engineering culture is driven by our values : we're a cooperative team that values individual authenticity and encourages creative solutions to problems. All new engineers deploy working code their first week, and we strive to broaden individual impact More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted: