1 to 17 of 17 Permanent Big Data Jobs in Scotland

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data … ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design and implement more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

Job Title :: Pyspark Data Engineer Job Type :: Permanent Work Model :: Edinburgh, Scotland, United Kingdom (HYBRID) Please find below the JD of Pyspark Data Engineer – Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. Hands on Azure … data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. Good Data analytics skill and able to communicate with customers/business users. more »

Job Description for Data Engineer - Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. Hands on Azure data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. Good Data analytics skill and able to communicate with customers/ more »

Exciting Opportunity: Python/Spark Big Data Software Engineer – Financial Services Sector 📍 Location: Glasgow 💼 Contract: 6 Months PAYE 💷 Rate: Up to £500 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the financial … services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods to … tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to-date more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the company grows … and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data quality, governance, integration, and transformation. About … overview of what the successful candidate will require (don’t worry if you don’t tick all the boxes!): Python for building and automating data pipelines. A solid understanding of ETL processes for data extraction, transformation, and loading. Experience with relational databases ( SQL ) and database design principles and more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a week from … home and 2 day in office/on client site. Responsibilities: Developing and optimizing data pipelines Building and maintaining data architectures Leading projects and teams Ensuring data quality and integrity Preferred skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration … and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data visualisation tools (PowerBI, Tableau, Qlik Sense) Additional skills: Client-facing and communication skills Leadership and mentoring capabilities more »

Do you want to join us at the heart of trust?From reviews to user behaviours to internal systems, at Trustpilot, we truly have big data. And, in our B2B Applied AI team, we’re focused on leveraging AI and ML to transform data into value and create … means you can empower product innovation to help our businesses build Trust and growth and Improve the experiences with Trustpilot.We are seeking a skilled Data Scientist to join our B2B Applied AI team to develop intelligent, data-driven product features that serve our Business Application. You will collaborate … closely with a cross-functional team of software developers, product managers, designers, data analytics and ML engineers to develop, deploy and maintain innovative AI/ML models at scale. You will be part of a unique journey of creating our B2B Digital Led growth and you will have the more »

Solid Understanding of Data Engineering Concepts and experience of Building and maintaining reliable and scalable big data platform. Experience of Integrating Azure hosted platforms within Enterprise capabilities including ServiceNow, CyberArc, Azure DevOps in an Enterprise Environment. Experience of Implementing Development lifecycle Including dependency management and DevOps and more »

artifacts for complex applications while being accountable for ensuring design constraints are met by software code development · Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture · Contributes to software engineering communities of practice and events that explore … and Security Preferred qualifications, capabilities, and skills: · Skilled with Python or PySpark · Exposure to cloud technologies (Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka) · Experience with Big Data solutions or Relational DB. · Experience in Financial Service Industry is a bonus. more »

as the ability to manage several tasks/projects concurrently and prioritize work effectively. • Experience in Risk and Finance or Regulatory reporting. • Understanding of Big Data Technologies, Cloudera, Spark • Experience in CI/CD pipeline implementation • Good exposure in Python Scripting more »

will be working within a global Agile squad responsible for developing Transaction Reporting systems with robust controls to ensure timeliness and accuracy of reported data to enable client to manage its risk. The role will expose the candidate to all phases of the production development lifecycle including working with … their requirements. There is scope to grow and learn both technically (migration to AWS/Azure Public cloud, being part of a modernization programme, big data management) as well as opportunity to deepen business understanding of financial regulations and products. Skill Set: Java 8, Kafka, Collections, Multi-threading … team. Willingness to learn domain fundamentals and explain calculation logic to users. Qualifications Computing fundamentals: Working knowledge of common search and sort algorithms, basic data structures such as lists, maps, trees, and graphs, multi-threaded programming, computer networking, and operating systems. Databases: Basic knowledge of SQL. Familiarity with non more »

measurement and outcomes across linear, CTV and digital for the world’s largest brands. Through a global infrastructure that enables cross-platform ad serving, data-driven creative, and currency-grade measurement, Innovid offers its clients always-on intelligence to optimize advertising investment across channels, platforms, screens, and devices. Innovid … culture, practice continuous deployment and no code ownership, and deal daily with the most advanced technologies and methodologies in software development, high scalability, and big data. The Impact You'll Make: Participate in designing and developing Innovid’s products in a multiple technologies, no code ownership environment Design and … science or a related discipline Experience with development of online, cloud based SaaS products – an advantage Good knowledge of SQL – an advantage Experience with Big Data development – an advantage Experience with web server or client side development – an advantage Experience with Linux in a production environment – an advantage more »

fast-paced industry Exposure to skills development on a complex and varied technology stack Potential to work in exciting domain areas including cloud services, big data, machine learning, audio, graphics, UI, hardware integration, eCommerce Exciting extra-curricular activities and great social gatherings If this sounds like an exciting more »

apply. Python App Developer Requirements: Proficiency with Python or PySpark. Exposure to cloud technologies such as Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka. Experience with Big Data solutions or Relational DB. Demonstrated knowledge of software applications and technical processes within a cloud or microservice architecture. Hands On practical experience more »

applications and e-commerce websites. The agency works on a diverse range of projects, from auction systems to high-traffic e-commerce site, and big data applications. We are now seeking an experienced and dynamic Account Manager to join their busy, growing, and successful team. Digital Marketing Account more »