About The Role
As an engineer specializing in Data Engineering, you will be an integral part of our fast-paced team. You will work closely with senior engineers to design, implement, and optimize data pipelines and systems using cutting-edge open-source tools. This role offers the opportunity to contribute directly to key projects, learn from experienced team members, and take on increasing responsibilities as you grow within the team.
Key Responsibilities
Data Pipeline Development :
- Assist in designing and building scalable ETL/ELT pipelines using tools.
- Participate in the development and maintenance of data processing workflows, ensuring data accuracy and reliability.
- Collaborate with the team to implement real-time and batch data solutions that meet business Tool Integration :
- Contribute to the integration and optimization of open-source data engineering tools.
- Work on integrating and managing databases to support various applications.
- Stay engaged with new developments in open-source technologies and bring innovative ideas to the team.
Collaboration And Learning
- Work closely with senior engineers and data scientists to understand data requirements and translate them into technical solutions.
- Engage in code reviews, pair programming, and team discussions to continuously improve your skills and contribute to the team’s success.
- Actively participate in team meetings and share your insights to help solve technical challenges.
System Monitoring And Improvement
- Monitor the performance of data systems and pipelines, identifying and addressing any issues proactively.
- Contribute to the ongoing optimization of data systems for better performance, scalability, and cost efficiency.
- Help implement best practices in data governance, security, and documentation.
Qualifications
- Education : Bachelor’s degree in Computer Science.
Experience
- 3-5 years of experience in software development and data engineering.
- Hands-on experience with open-source data pipeline tools.
- Strong programming skills in languages like NodeJs, Golang and Java.
- Proficiency in SQL and experience with both relational and NoSQL databases.
Skills
- Solid understanding of data warehousing concepts, ETL processes, and data modeling.
- Experience with CI/CD pipelines, containerization, and orchestration tools.
- Strong problem-solving skills and a willingness to learn and adapt in a dynamic environment.
- Excellent communication skills, with the ability to work collaboratively in a fast-paced, team-oriented environment.
Preferred Qualifications
- Experience in operating with self-hosted infrastructure across all major cloud platforms.
- Participation in or contributions to open-source projects.
- Exposure to data visualization tools and techniques.