Scala. Experience with SQL, NoSQL, and data visualization tools. Strong analytical and problem-solving skills. Knowledge of social media analytics and user behavior. Familiarity with big data technologies like Hadoop, Spark, Kafka. Knowledge of AWS machine learning services like SageMaker and Comprehend. Understanding of data governance and security in AWS. Excellent communication skills and attention to detail. Compensation: This More ❯
native environments. · Familiarity with containerization (Docker, Kubernetes) and DevOps pipelines. · Exposure to security operations center (SOC) tools and SIEM platforms. · Experience working with big data platforms such as Spark, Hadoop, or Elastic Stack. #J-18808-Ljbffr More ❯
e.g., Kubernetes). Preferred Skills: Experience with feature stores (e.g., Feast, Tecton). Knowledge of distributed training (e.g., Horovod, distributed PyTorch). Familiarity with big data tools (e.g., Spark, Hadoop, Beam). Understanding of NLP, computer vision, or time series analysis techniques. Knowledge of experiment tracking tools (e.g., MLflow, Weights & Biases). Experience with model explainability techniques (e.g., SHAP More ❯
e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Experience in Computer Science, Engineering, Mathematics, or a related field and expertise in technology disciplines Exposure to big data frameworks (Spark, Hadoop etc.) used for scalable distributed processing Ability to collaborate effectively with Data Scientists to translate analytical insights into technical solutions Preferred Qualifications, Capabilities, And Skills Familiarity with No SQL More ❯
skills Formal training or certification on software engineering concepts and applied experience Experience in dealing with large amount of data, Data Engineering skills are desired Proven experience in Spark, Hadoop, Databricks and Snowflake Hands-on practical experience delivering system design, application development, testing, and operational stability Advanced in one or more programming language(s) i.e. Java or Python Advanced More ❯
As a Scala Data Engineer, you will design, develop, and maintain Scala applications for Big Data purposes. In this role, you will be responsible for migrating an on-premise Hadoop system onto the AWS cloud platform. Designing and implementing ETL pipelines, and using a combination of Big Data technologies and modern cloud stack will be your day-to-day. … Requirements: Strong Scala Programming Experience (Data) Hadoop Experience AWS Experience This role is an urgent requirement; please do not hesitate to apply or you could miss this opportunity! Get in touch by contacting me at j.shaw-bollands@tenthrevolution.com or on 0191 338 6641! Keywords: Big Data, Hadoop, Scala, Spark, AWS, Migration, Data Engineer, Consultancy, Banking, Finance #J More ❯
enterprise-level systems; Excellent object-oriented design skills, including OOA/OOD; Experience with multi-tier architectures and service-oriented architecture; Exposure to and understanding of RDBMS, NoSQL, and Hadoop is desirable; Knowledge of the software development lifecycle and agile practices, including TDD/BDD; Strategic thinking, collaboration, and consensus-building skills. Please note: Familiarity with DevOps is important More ❯