Job Type: 6+ month and possibility of extension Looking for an enthusiastic Spark Scala Engineer who will be responsible for designing, building, and maintaining data pipelines using Apache Spark and Scala. This includes tasks like: Extracting data from various sources (databases, APIs, files) Transforming and cleaning the data Loading the data into data warehouses or data lakes (eg, BigQuery, Amazon Redshift) Automating the data pipeline execution using scheduling tools (eg, Airflow) Data analysis and modelling: While the primary focus might be on data engineering, some JDs might require basic data analysis skills: Writing analytical queries using SQL or Spark SQL to analyse processed data and Building simple data models to understand data relationship. Work with BigData technologies: You'll likely work with various BigData technologies alongside Spark, including: Hadoop Distributed more »
with a creative mindset. Great attention to detail and quality focused. Keen to build operational knowledge in 21st century IT (Cloud, Social, Mobility, IoT, BigData, etc). Appetite to learn and apply architecture best practices and patterns. Understanding of other programming languages and the software development lifecycle more »
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
LSA Recruit
Foundry Specialist/Architect to join our team. The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data integration, analytics, and operational decision-making capabilities. As a Palantir Foundry Specialist/Architect, you will be responsible for designing, developing, and maintaining data-driven solutions that leverage Palantir Foundry's platform to address complex business challenges. Key Responsibilities: *Solution Architecture:* - Design and architect end-to-end data solutions using Palantir Foundry, ensuring alignment with business goals and technical requirements. - Develop scalable and efficient data models, pipelines, and workflows within the … Foundry environment. - Collaborate with stakeholders to understand business needs and translate them into technical requirements and solutions. *Data Integration:* - Implement data integration solutions to ingest, transform, and manage large datasets from various sources into Palantir Foundry. - Ensure data quality, consistency, and security throughout the data life more »
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Walsh Employment Ltd
applications and e-commerce websites. The agency works on a diverse range of projects, from auction systems to high-traffic e-commerce site, and bigdata applications. We are now seeking an experienced and dynamic Account Manager to join their busy, growing, and successful team. Digital Marketing Account more »