3 Big Data Jobs in West Yorkshire

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency more »

Solutions Architect - Data Product UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business. … Solutions Architect, you will take responsibility for the platform design and architecture ahead of a migration from legacy to a brand new AWS cloud data platform. Requirements: Experience with AWS cloud data platforms Strong understanding of the role of architecture in enterprise data projects Proven commercial experience … migrating on prem solutions to the cloud, including re-architecting Prior experience working on data focused projects e.g. data warehousing, big data, data streaming Proficiency with Apache Kafka, Apache Spark, Apache Flink etc. We are an equal opportunities employer and welcome applications from all suitably more »

with a creative mindset. Great attention to detail and quality focused. Keen to build operational knowledge in 21st century IT (Cloud, Social, Mobility, IoT, Big Data, etc). Appetite to learn and apply architecture best practices and patterns. Understanding of other programming languages and the software development lifecycle more »