8 of 8 Apache Spark Jobs in Bristol

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam.Expert understanding of when to use a range of data storage technologies including relational/non-relational, document ...

ResponsibilitiesData Pipeline DevelopmentData Platform ManagementStakeholder CollaborationLeadership & MentorshipTechnology StackThe successful candidate will have experience working with some or all of the following technologies:Data Processing: Apache Spark/PySparkWorkflow Orchestration: Apache AirflowContainerisation: KubernetesCloud Platform: Microsoft AzureData APIs & Semantic Layer: CubeJSProgramming Languages: Python, SQLEssential Skills & ExperienceDegree in a STEM ...

architecture (SQL and NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team ...

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...

Azure Data Lake Storage.Advanced SQL development and performance tuning skills, including experience with Azure SQL Database and SQL Server.Proficiency in Python, PySpark, Scala and Spark for data processing and distributed computing.Understanding of data warehousing concepts, dimensional modelling and ETL/ELT frameworks.Knowledge of data quality, data governance, metadata management … scale data solutions.Collaborative working environment with opportunities to contribute to continuous improvement initiatives.If you are an experienced Data Engineer with expertise in Azure, Databricks, Spark, SQL, Scala and Python, apply now to develop your career while delivering innovative data solutions. ...

DynamoDB. Work with large volumes of structured and unstructured data, integrating information from multiple sources. Develop data solutions using technologies including Python, Java, Scala, Spark and SQL. Write scripts, develop APIs and SQL queries, and contribute to the design and deployment of scalable cloud-based data platforms. Work closely … data environment. Strong experience with AWS cloud technologies and data engineering services. Hands-on experience with one or more of Python, Java, Scala, Spark and SQL. Experience working with large-scale structured and unstructured datasets. Understanding of data ingestion, processing, transformation and integration. Strong analytical and problem-solving skills. ...