8 Big Data Jobs in Yorkshire

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency more »

Solutions Architect - Data Product UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business. … Solutions Architect, you will take responsibility for the platform design and architecture ahead of a migration from legacy to a brand new AWS cloud data platform. Requirements: Experience with AWS cloud data platforms Strong understanding of the role of architecture in enterprise data projects Proven commercial experience … migrating on prem solutions to the cloud, including re-architecting Prior experience working on data focused projects e.g. data warehousing, big data, data streaming Proficiency with Apache Kafka, Apache Spark, Apache Flink etc. We are an equal opportunities employer and welcome applications from all suitably more »

to existing processes and systems. Foster productive relationships with key internal stakeholders and external suppliers. Utilize subject matter expertise to integrate, transform, and consolidate data from diverse structured, unstructured, and streaming data systems into appropriate schemas for analytics solutions. Assist stakeholders in comprehending data through exploration and … develop secure, compliant data processing pipelines using a variety of tools and methods. Leverage Azure data services and frameworks to store and generate refined datasets for analysis, with the flexibility to adopt different architecture patterns such as Modern Data Warehouse (MDW), Big Data, and Lakehouse … Architecture. Ensure the operationalization of data pipelines and stores meet high-performance, efficiency, organization, and reliability standards, aligned with business requirements and constraints. Identify and resolve operational and data quality issues, and design, implement, monitor, and optimize data platforms to support data pipelines. Requirements: Technical: Proficient more »

design a comprehensive plan for implementation. Responsibilities: Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of … large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance … accurate implementation of the solution design. Required Skills: Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »

Responsibilities: Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of large-scale data. Design scalable and … resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance and technical leadership to development teams … accurate implementation of the solution design. Required Skills: Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »

digital and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of … large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance … of the solution design. Key Skills/requirements Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »

with a creative mindset. Great attention to detail and quality focused. Keen to build operational knowledge in 21st century IT (Cloud, Social, Mobility, IoT, Big Data, etc). Appetite to learn and apply architecture best practices and patterns. Understanding of other programming languages and the software development lifecycle more »

with the sharpest possible prices and with locally available inventory. We develop scalable systems and services, and utilizing cutting edge technology (e.g., machine leaning, big data, etc.), to enable world-class global logistics solutions. We are currently looking for a Sr. Product Manager to join our growing organization. … be defining the vision for how Sellers and Amazon manage fulfilment globally. You will own developing and executing against a multi-year roadmap, leveraging data and insights from our Sellers and inventing new technology to deliver innovations which help Sellers grow and expand their business on Amazon. You will … are open to hiring candidates to work out of one of the following locations: London, GBR PREFERRED QUALIFICATIONS Experience in influencing senior leadership through data driven insights Experience working across functional teams and senior stakeholders Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce more »