with tools and packages like Pandas, NumPy, scikit-learn, Plotly/Matplotlib, and Jupyter Notebooks. Knowledge of ML-adjacent technologies, including AWS SageMaker and Apache Airflow. Proficiency in data pre-processing, data wrangling, and augmentation techniques. Experience with cloud platforms (e.g. AWS, Google Cloud, or Azure) for deploying scalable More ❯
science, engineering, mathematics or a related technical field Experience with object-oriented programming preferred General familiarity with some of the technologies we use: Python, Apache Spark/PySpark, Java/Spring Amazon Web Services SQL, relational databases Understanding of data structures and algorithms Interest in data modeling, visualisation, and More ❯
science, engineering, mathematics or a related technical field Experience with object-oriented programming preferred General familiarity with some of the technologies we use: Python, Apache Spark/PySpark, Java/Spring Amazon Web Services SQL, relational databases Understanding of data structures and algorithms Interest in data modeling, visualisation, and More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
M-KOPA
general analytics use case. Additionally, having experience with Kubernetes or other platforms for containerized applications as well as working with orchestration systems such as Apache Airflow would be essential to succeed in this role. The ideal candidate for this role would need to have proficiency in programming languages (Python More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, data lakes, and data warehouses. Hands-on experience with Apache Spark and bonus points for Microsoft Fabric. Any certifications are a bonus. Hybrid work once a week into their Edinburgh office Learning and Development More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, data lakes, and data warehouses. Hands-on experience with Apache Spark and bonus points for Microsoft Fabric. Any certifications are a bonus. Benefits: Competitive base salary Hybrid work once a week into their Edinburgh More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
JR United Kingdom
in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, data lakes, and data warehouses. Hands-on experience with Apache Spark and bonus points for Microsoft Fabric. Any certifications are a bonus. Hybrid work once a week into their Edinburgh office Learning and Development More ❯
with cloud platforms (AWS, GCP, Azure) Experience with CI/CD pipelines for machine learning (e.g., Vertex AI) Familiarity with data processing tools like Apache Beam/Dataflow Strong understanding of monitoring and maintaining models in production environments Experience with containerization tools (e.g., Docker) Problem-solving skills with the More ❯
software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Canonical
advanced statistics, data sciences, coding/scripting languages (Python, JS, etc), and databases (SQL, etc) Strength in data analytics and visualisation (Looker Studio, Tableau, Apache Superset, etc) Ability to translate business questions to key research objectives Ability to identify the best methodology to execute research, synthesise and analyse findings More ❯
Networking troubleshooting skills, including TCP/IP, OSI model, firewalls, IP addressing, SNMP, Syslog, ICMP, SSH, REST API, Webhooks Experience with Linux services like Apache and nginx, and deploying Linux-based applications Experience with appliance-type applications support Desirable Skills: ITIL Foundation certification Knowledge of TACACS+ and ITSM systems More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Canonical
of advanced statistics, data science, coding/scripting languages (Python, JS), and databases (SQL) Strength in data analytics and visualization tools (Looker Studio, Tableau, Apache Superset) Ability to translate business questions into research objectives Ability to select appropriate research methodologies and analyze findings Excellent writing and communication skills Resilience More ❯
analytical, problem-solving, and critical thinking skills. 8.Experience with social media analytics and understanding of user behaviour. 9.Familiarity with big data technologies, such as Apache Hadoop, Apache Spark, or Apache Kafka. 10.Knowledge of AWS machine learning services, such as Amazon SageMaker and Amazon Comprehend. 11.Experience with data More ❯
processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres … sql server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ More ❯
processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres … sql server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ More ❯
EC2 services. • Utilize AWS RDS databases for storing and managing structured data. • Design, implement, and manage batch job workflows using tools like AutoSys and Apache Airflow. • Schedule and monitor batch jobs, ensuring timely and successful execution. • Troubleshoot and resolve issues related to batch processing. • Collaboration and Communication: • Work closely … Linux skills, including scripting and system administration. • Proficiency with AWS cloud services and RDS databases. • Proficiency in batch orchestration tools such as AutoSys and Apache Airflow. • Excellent problem-solving and analytical skills. • Strong understanding of data integration and ETL processes. • Ability to work in a fast-paced, dynamic environment. More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Widen the Net Limited
Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting … ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing -Design and develop scalable ETL pipelines to automate data processes and optimize delivery -Implement and manage data warehousing solutions … ensuring data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements: -5+ years of experience in SQL -5+ years of development in Python -MUST have strong experience in ApacheMore ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
JR United Kingdom
early and providing strategic guidance. Support the ongoing development of integration strategies involving Managed File Transfer solutions (e.g., GoAnywhere) and data orchestration platforms (e.g., Apache Airflow). Provide hands-on support and detailed guidance on particularly complex integration designs where necessary. Maintain current knowledge of industry trends, technology advancements … and migrations. Familiarity with IBM Maximo asset management platform. Knowledge and experience with Managed File Transfer solutions (e.g., GoAnywhere). Understanding and experience with Apache Airflow orchestration platform. Strong grasp of integration best practices, security considerations, and data flow management. Ability to work collaboratively across distributed teams and multiple More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
JR United Kingdom
Social network you want to login/join with: Product Specialist, Geospatial Solutions, edinburgh col-narrow-left Client: Idox plc Location: edinburgh, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 More ❯