Duties & Responsibilities
Seeking a professional data engineer is a professional with expertise in designing, building and maintaining infrastructure and systems, whilst working in conjunction with Data Scientists and Software Engineers
Some key responsibilities of a data engineer include:
Designing, building, and maintaining data pipelines that move data from various sources into a data warehouse or other storage systems
Creating and optimizing data storage solutions for efficient and cost-effective data retrieval and analysis
Developing and maintaining data security and privacy measures
Building and deploying machine learning models
Ensuring data quality and integrity through the use of automated testing and validation
Collaborating with other teams and stakeholders to identify and understand data requirements
Continuously monitoring and tuning data infrastructure to ensure optimal performance and scalability
Experience with programming languages like Python and SQL
Strong understanding of distributed systems, data modelling, and data warehousing concepts.
The role requires a bachelor’s degree in computer science, engineering, or a related field, and several years of experience working with data systems.