6 of 6 Apache Spark Jobs in Bristol

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non-relational, document ...

architecture (SQL and NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team ...

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...

DynamoDB. Work with large volumes of structured and unstructured data, integrating information from multiple sources. Develop data solutions using technologies including Python, Java, Scala, Spark and SQL. Write scripts, develop APIs and SQL queries, and contribute to the design and deployment of scalable cloud-based data platforms. Work closely … data environment. Strong experience with AWS cloud technologies and data engineering services. Hands-on experience with one or more of Python, Java, Scala, Spark and SQL. Experience working with large-scale structured and unstructured datasets. Understanding of data ingestion, processing, transformation and integration. Strong analytical and problem-solving skills. ...