6 of 6 Apache Spark Jobs in Bristol

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam.Expert understanding of when to use a range of data storage technologies including relational/non-relational, document ...

toolsUnderstanding of database architecture (SQL and NoSQL)Experience with cloud technologiesExperience with cloud platformsExperience with CI/CD practicesExperience with big data tools e.g. Spark, Hadoop, NiFiExperience managing direct reports, providing regular guidance and performance feedbackAbility to create delivery plans with estimated timelines for personal and team workloadsExperience supporting ...

architecture (SQL and NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team ...

native architectures.Hands-on experience with Python, SQL and modern software engineering practices.Experience building large-scale batch and streaming data solutions using technologies such as Spark, Kafka, Flink, Beam or equivalent.Deep knowledge of modern data architectures including data warehouses, data lakes and lakehouse platforms.Strong understanding of analytical data modelling, dimensional ...

event-driven technologies, such as:Testing & Automation: PyTest, Cucumber, Behave, DBT, GreatExpectations, GCP DVT, Monte Carlo, Soda, Deequ, RestAssured etcData Engineering & Orchestration: BigQuery, Spanner, Apache Kafka, Airflow, Spark, Cloud Composer, DAGs, Apache Beam, Pub/Sub, Dataflow, DataStage, Teradata, Snowflake, ETL, SQL etcData Governance & Visualisation: Looker, Ataccama ...