126 to 142 of 142 Apache Spark Jobs in the South East

TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL, and data modeling. Familiarity with cloud platforms (AWS, Azure, GCP) for deploying ML and More ❯

fields. Possess offensive and defensive thinking with an understanding of mainstream security threats and defense strategies. Proficient in data analysis tools such as SQL, Spark, Python. Excellent project management skills with experience in large-scale internet operations, microservice architecture, big data analysis, and security compliance is a plus. More ❯

programmation en Python/R serait un atout, tout comme la connaissance de SQL. La connaissance de l'écosystème Big Data (par exemple Hive, Spark, Scala) serait un plus. Expérience préalable dans la manipulation et la compréhension de données complexes provenant de sources multiples. Une compréhension des techniques Data More ❯

quality data solutions. Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions. Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python. Good to have: Cloudera – Spark, Hive, Impala, HDFS, Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin. Qualifications: Bachelor's More ❯

learning models, and create robust solutions that enhance public service delivery. Working in classified environments, you'll tackle complex challenges using tools like Hadoop, Spark, and modern visualisation frameworks while implementing automation that drives government efficiency. You'll collaborate with stakeholders to transform legacy systems, implement data governance frameworks … analytics platforms e.g. relevant AWS and Azure platform services; Data tools hands on experience with Palantir ESSENTIAL; Data science approaches and tooling e.g. Hadoop, Spark; Data engineering approaches; Database management, e.g. MySQL, Postgress; Software development methods and techniques e.g. Agile methods such as SCRUM; Software change management, notably familiarity More ❯

Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting … scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing -Design and develop scalable ETL pipelines to automate data processes and optimize delivery -Implement and … manage data warehousing solutions, ensuring data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements: -5+ years of experience in SQL -5+ years of development in Python -MUST have strong More ❯

of Data Science Lead the data science strategy and team to deliver data science solutions e.g. retention, acquisitions and customer management using Python and Spark Lead the hiring to build a great pool of Data Scientists and Engineers for the team and support the recruitment activities of other data More ❯

to a range of audiences. Able to provide coaching and training to less experienced members of the team. Essential Skills: Programming Languages such as Spark, Java, Python, PySpark, Scala or similar (minimum of 2). Extensive Big Data hands-on experience across coding/configuration/automation/monitoring … Work in the UK long-term as our client is NOT offering sponsorship for this role. KEYWORDS Lead Data Engineer, Senior Lead Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake. Please More ❯

Hyperledger framework would be very appreciated. A first experience using Mobile technologies in Android/iOS environment, Big Data technologies such as Cassandra/Spark/NoSQL is an asset. Work within our team of passionate and talented developers. Design, implement and test platforms and Apps. Deal with cryptocurrencies More ❯

Social network you want to login/join with: SR2 | Socially Responsible Recruitment | Certified B Corporation Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col More ❯

Join to apply for the Senior/Lead Big Data Engineer (Scala/Spark) role at Grid Dynamics . Responsibilities Development of Spark jobs for data synchronization between different storage systems. Development of big data pipelines and infrastructure. Planning and deploying data schemas for data warehousing. Designing, developing … efficient backend code in Java/Scala. Optimizing Postgres databases and handling complex queries. Creating automated build processes using Gradle. Requirements Strong expertise in Spark and Scala. Hands-on experience with Hadoop. Proficiency with data processing frameworks like Kafka and Spark. Experience with database engines such as Oracle, PostgreSQL More ❯

RESTful and event-driven APIs. Establish best practices for versioning, documentation, security, and monitoring. Build and manage data streaming pipelines using frameworks such as Spark, Kafka, or equivalents. Ensure high-availability and low-latency delivery of market and industry data. Deploy and operate services on Azure using Functions, App … and code reviews to foster team knowledge sharing. What we are looking for Hands-on experience building and operating real-time streaming solutions (e.g., Spark Streaming, Kafka, Event-Hub) Thorough understanding of Azure services (Functions, App Services, AKS). Proven design and integration with deploying API frameworks (e.g. FastAPI More ❯

Job Location COBALT PARK GO Job Description Are you ready to kickstart your tech career with the top-rated company for graduates in Fast Moving Consumer Goods (FMCG)? Do you want to be part of a company that develops the More ❯

systems, tools, and validation strategies to support new features Help design/build distributed real-time systems and features Use big data technologies (e.g. Spark, Hadoop, HBase, Cassandra) to build large scale machine learning pipelines Develop new systems on top of real-time streaming technologies (e.g. Kafka, Flink) Minimum … in Java, Shell, Python development Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate) is a plus Experience in Cassandra, HBase, Flink, Spark or Kafka is a plus. Experience in the Spring Framework is a plus Experience with test-driven development is a plus Must be located More ❯

and GCP. Govern enterprise-wide data models, pipelines, and AI frameworks for ingestion, storage, and processing. Build real-time and batch data solutions using Spark, Kinesis, and Pub/Sub. Develop machine learning pipelines, MLOps best practices, and automated model deployment. Architect cloud-based data lakes, warehouses, and AI … ML platform construction. Good with artificial and machine learning systems (Google Vertex AI, Azure ML, AWS SageMaker) and contemporary data tools (BigQuery, Databricks, Snowflake, Spark). Good grasp of accountable artificial intelligence, ethics, and model explainability. Proficient in integrating artificial intelligence with API-first, microservices, and event-driven designs. More ❯

Bayesian Data Scientist Location: London (Hybrid Working) Contract Type: Initial 12 month contract + potential to extend long-term due to 3/4 year project scope. Start Date: ASAP We have an excellent opportunity for a Bayesian Data Scientist More ❯

Graduate/Junior Quantitative Analyst – Sports betting - London *Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship* Job Summary Graduate/Junior Quantitative Analyst is required for one of the leading providers of sports More ❯