3 of 3 Apache Spark Jobs in Bristol

ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam.Expert understanding of when to use a range of data storage technologies including relational/non-relational, document ...

ResponsibilitiesData Pipeline DevelopmentData Platform ManagementStakeholder CollaborationLeadership & MentorshipTechnology StackThe successful candidate will have experience working with some or all of the following technologies:Data Processing: Apache Spark/PySparkWorkflow Orchestration: Apache AirflowContainerisation: KubernetesCloud Platform: Microsoft AzureData APIs & Semantic Layer: CubeJSProgramming Languages: Python, SQLEssential Skills & ExperienceDegree in a STEM ...

Azure Data Lake Storage.Advanced SQL development and performance tuning skills, including experience with Azure SQL Database and SQL Server.Proficiency in Python, PySpark, Scala and Spark for data processing and distributed computing.Understanding of data warehousing concepts, dimensional modelling and ETL/ELT frameworks.Knowledge of data quality, data governance, metadata management … scale data solutions.Collaborative working environment with opportunities to contribute to continuous improvement initiatives.If you are an experienced Data Engineer with expertise in Azure, Databricks, Spark, SQL, Scala and Python, apply now to develop your career while delivering innovative data solutions. ...