1 to 1 of 1 Contract Data Lake Jobs in Yorkshire

Type: 6+ month and possibility of extension Looking for an enthusiastic Spark Scala Engineer who will be responsible for designing, building, and maintaining data pipelines using Apache Spark and Scala. This includes tasks like: Extracting data from various sources (databases, APIs, files) Transforming and cleaning the … data Loading the data into data warehouses or data lakes (eg, BigQuery, Amazon Redshift) Automating the data pipeline execution using scheduling tools (eg, Airflow) Data analysis and modelling: While the primary focus might be on data engineering, some JDs might require basic data analysis skills: Writing analytical queries using SQL or Spark SQL to analyse processed data and Building simple data models to understand data relationship. Work with Big Data technologies: You'll likely more »