Position Overview

As a Data Engineer, you will play a key role in designing, building, and maintaining a scalable and secure data platform in a cloud environment. You will work closely with cross-functional teams ensure seamless integration and delivery of data services that support business initiatives

Key Responsibilities

• Design, build, and maintain scalable and robust data pipelines to support business analytics, machine learning and reporting needs.

• Develop and optimize data models and data sets to ensure efficient
  processing and storage.

• Support new inbound & outbound data sources to increase capabilities of the data platform

• Collaborate with analysts, developers, and other stakeholders to understand data requirements and deliver valuable solutions.

• Implement data quality checks and validation processes to ensure data accuracy, consistency and integrity.

• Monitor and troubleshoot data pipeline performance and implement enhancements as needed.

• Collaborate on technical specifications, processes, and data models to facilitate standards, knowledge sharing and collaboration.

• Ensure security, compliance, and data integrity by safeguarding adherence to standards & best practices.

• Support disaster recovery and data backup processes to safeguard critical information.

• Optimize data queries, partitions, and storage to enhance performance, reduce costs, and ensure efficient resource utilization

Requirements

• Proven experience as a Data Engineer or similar role.

• Strong proficiency in Python.

• Experience with big data technologies like Spark or Hadoop.

• Knowledge of data storage formats and technologies, such as Avro, Parquet, Delta Lake and SQL databases.

• Experience with ETL tools and data pipeline orchestration (e.g.,
  Databricks LakeFlow, Notebook scripting).

• Strong knowledge of data warehousing solutions and best practices.

• Experience with end-to-end analytics platforms such as Microsoft Fabric, Databrick or Snowflake

• Experience with Git & CI/CD integrations using tools such as GitLab

• Experience working with event streaming technologies such as Kafka

• Experience with cloud infrastructure, containerization technologies, and infrastructure-as-code solutions like Terraform.

• Familiarity with agile methodologies and practices.

• AWS Certified Data Engineer or Azure Data Engineer certification.
  

  
  

The above duties provide a generic description of the Employee’s day to day responsibilities but should in no way be deemed to be an exhaustive list. Additional related, duties may be assigned by the Line Manager in line with business exigencies and continuity.

Why Work With Us?

At Silverspin, we take bold but thoughtful approaches to what we build and how we work. We act with confidence and responsibility, focusing on smart decisions, meaningful impact, and long-term success.

Joining us means being part of a team that values curiosity, ownership, and collaboration. We encourage people to challenge ideas, simplify complexity, and grow together - creating an environment where great work (and good energy) go hand in hand.

We offer:

• Competitive salary and benefits

• Opportunities to learn, grow, and develop

• A creative, collaborative team environment

Silverspin is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.