226 to 250 of 593 Data Lake Jobs

Cloud Data Architect (Manager) – BIP xTechAbout BIPBIP is an international consultancy working with leading organisations to deliver transformation, create long-lasting value and shape the future with confidence. We bring together deep industry expertise, innovative thinking and a collaborative approach to help our clients solve complex challenges … ValueWe Are Creators of Our Own FutureTogether We Go FurtherAbout BIP xTechBIP xTech is BIP's Centre of Excellence for Artificial Intelligence, Big Data, and Modern Data Platforms. We work with our clients to design and deliver scalable, cloud-native data platforms that enable ...

delivery. What You'll Take On: Joining the BIS domain, you will leverage tools such as Azure stack (Azure Data Factory, Azure Datalake), Databricks and PowerBI to innovate and streamline workflows to provide valuable data for the business . Working as part of a product team … infrastructure. Technical Expertise Languages: Strong proficiency in SQL and Python. Data Platform: Hands-on experience with Azure Data Lake and Databricks. Data Integration (ETL): Proven capability in building efficient data pipelines using Azure Data Factory (ADF), SSIS ...

delivery. What You'll Take On: Joining the BIS domain, you will leverage tools such as Azure stack (Azure Data Factory, Azure Datalake), Databricks and PowerBI to innovate and streamline workflows to provide valuable data for the business . Working as part of a product team … infrastructure. Technical Expertise Languages: Strong proficiency in SQL and Python. Data Platform: Hands-on experience with Azure Data Lake and Databricks. Data Integration (ETL): Proven capability in building efficient data pipelines using Azure Data Factory (ADF), SSIS ...

Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering … best practices and emerging trends in data engineering. This is an exciting and valuable opportunity for an enthusiastic, earlier-stage data engineer to advance their career across a variety of commercial sectors. At Optima, you’ll work within cross-functional teams, collaborating with experts in different ...

LGBTQ+ business community. Please do not contact the recruiter directly. About the job you're considering We are looking for an experienced Lead Data Engineer to help shape and grow our data engineering capability on the south coast, based out of our new Hove office. … pipeline design, build, monitoring and operations. • Batch and real-time data integration patterns. • AWS cloud data platforms. • Data lake, lakehouse, warehouse or large-scale analytical platform delivery. • Python, Bash or other scripting and automation approaches. • Workflow orchestration and scheduling tools, such as Airflow ...

Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within … relatively low maturity Azure environment. You will design, build and maintain data migration and ingestion pipelines, support the Azure Data Lake, and create integrations between source systems, Azure Data Lake and Databricks. Collaboration with stakeholders will shape data transformation ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

shape the future of prediction markets with cutting-edge technology and a customer-first philosophy, Smarkets is where you belong. The Team The Data Team is responsible for taking the wealth of data that Smarkets generates and using it to drive insights which improve the business. … understand and drive business direction. Data components can also be user facing e.g. sending notifications to users; Ensuring our data lake is kept in a healthy state, particularly our data warehouses: Redshift and Bigquery; Developing and maintaining Flask services and Postgres databases within ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

government client is looking for candidates who have at least one production AI/ML implementation, recent experience with AWS data services, Terraform, CI/CD, Python, and SQL. Candidates should have more than five years of overall experience and meet the other requirements outlined in the attached … solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform ...

high‐performing connectivity across a global footprint. Experience with Palo Alto's extended security suite, including GlobalProtect, Prisma Access, Panorama, Cortex Data Lake, and DLP, is essential. Key Responsibilities Architect, deploy, and manage Azure‐based network infrastructure, including VNets, Azure Firewall, Application Gateway, NSGs, Load Balancers, Private … Panorama and security extension through Prisma Access. Deploy and administer GlobalProtect for secure remote access across endpoints and locations. Leverage Cortex Data Lake for threat visibility and log analytics; implement and monitor Data Loss Prevention (DLP) policies. Collaborate with cloud, application, and infrastructure teams ...

processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data … Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats. J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments ...

Work—reflecting our commitment to our people and our culture. For more details, visit: Website or LinkedIn Page Role: Associate Technical Architect - Data Experience Level: 8+ years Employment type: Full Time Location: Remote (UK) Basic Qualifications: 8+ years of experience in designing and implementing data warehouses … distributed teams in collaborative delivery environments. Deep working knowledge across key AWS Data & Analytics services, including: Building large-scale data lake architectures on Amazon S3 and open table formats Implementing governance and cataloging through AWS Lake Formation. Developing ETL and metadata frameworks using ...

processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data … Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats. #J-18808-Ljbffr ...

outcome. As strategies, technologies, and innovation collide, we create opportunity from complexity. Firm PA Consulting Location Bristol, United Kingdom Benefits Competive Functional areas Data Science Address 2 Avon Street, Bristol BS2 0GR, GB Hours Full-time Company Description We believe in the power of ingenuity to build … business needs into scalable, resilient, and secure data solutions. Our tech stack Multi‐cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

Photon Group in London, UK is seeking a Data Engineer/Data Analyst … support a major ledger migration and data clean-up in a financial services setting. You will work across the data lake, reporting systems, and downstream feeds to ensure data integrity and robust processes. The role focuses on large-scale batch processing, data ...

Ready to turn complex data into powerful insights that shape the future of home improvement? Join Wickes as our new Senior Data Analyst. Role Purpose: At Wickes, we’re on a mission to create simple, digital-first experiences that help our customers build, repair, and improve … What you’ll be doing: Deep Dive Analysis : Deliver detailed, relevant insights that empower business areas to make smart, impactful decisions. Data Lake Development: Collaborate with key stakeholders and fellow analysts to shape the development of our Data Lake, recommending and implementing robust analytical ...

Elevate your career by steering multi-faceted technology programs, integrating innovative solutions, and driving impact across global operations. The Chief Data & Analytics Office (CDAO) at JPMorganChase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity, and security … data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutions Experience navigating complex ...

Engineer/Data Analyst to support ledger migration and data clean-up initiatives across the data lake, reporting systems and downstream feeds. You will engage in large-scale batch processing, data validation, regression testing and migration readiness. Applicants must ...

Wickes in Watford is seeking a Senior Data Analyst to turn complex data into insights that shape our home improvement business. You’ll support multiple departments with advanced analytics … scoping, and hands-on training, with occasional travel to Northampton. You’ll own data quality, help develop our Data Lake, and deliver robust reporting. The role requires strong SQL, experience with BI tools and cloud data warehouses, and excellent communication to translate data ...

strategic, sustainable decisions by bringing transparency to markets across the world. We create a comprehensive view of commodities markets, providing companies with the data and intelligence to successfully navigate across global value chains every day. Our customers benefit from instant access to price assessments, reports and forecasts … link below. https://www.icis.com/explore About the role: To provide dedicated analytical capability within Customer Intelligence, connecting customer research, CRM data, product usage data and business performance metrics into clear, actionable insight. This role is designed to build future data science ...

About UBDS Digital UBDS Digital, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI, cyber security and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. … highly governed environments Experience with Azure data and integration technologies such as Data Factory, Synapse Analytics, Data Lake Storage, Functions, Logic Apps or API Management Experience with Azure Databricks in large-scale enterprise environments Knowledge of enterprise application and data integration ...

your playing field. Join us in shaping the future of gaming. Are you ready to LEVEL-UP THE GAME? As a Senior Data Architect, you will be at the forefront of modernising our A&I (Automation & Insights) data platform architecture and driving operational excellence through automation. … United remains a leader in the data-driven online gambling industry. Your work will involve shaping lakehouse and data-lake paradigms, leveraging Parquet and Iceberg for high-performance data storage, and adopting scalable Spark frameworks for large-scale processing. Ultimately, you will enable ...

edge manufacturing, turning abstract ideas into realities that transform the world for good. Your impact This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity … workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets ...

Senior Systems Manager - Data Application Deadline: 29 June 2026 Department: IT and Business Systems Employment Type: Permanent - Full Time Location: Silverstone Description As Senior Systems Manager for Data at Silverstone Circuits, you will be the founder member of our new data team … will lead and support the shaping of this key new capability for Silverstone. You will be responsible for the engineering and governance of our Datalake while acting as a business partner and change advocate, ensuring Silverstone can use data effectively. You’ll bridge technical solutions with commercial objectives ...