Description
We are looking for a Data Engineer to help build and maintain a robust and scalable data platform. You will be instrumental in designing, implementing, and optimizing data pipelines, ensuring high-quality data for various analytical and operational needs. As a Data Engineer on our team, you will play a crucial role in shaping our data infrastructure, collaborating closely with cross-functional teams to deliver impactful data solutions that drive business growth.
Responsibilities
- Design, build, and maintain scalable and reliable data pipelines using various technologies.
- Collaborate with data scientists, analysts, and other engineers to understand data requirements and translate them into technical solutions.
- Optimize data warehousing solutions for performance and cost-effectiveness.
- Implement and maintain data quality checks and monitoring to ensure data accuracy and reliability.
- Develop and maintain documentation for data pipelines, data models, and data governance policies.
- Stay up-to-date with emerging data technologies and recommend their adoption when appropriate.
- Participate in on-call rotations to support critical data infrastructure.
Qualifications
- 5+ years of experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL and experience with various relational and NoSQL databases.
- Expertise in designing, building, and optimizing data pipelines using tools like Spark, Flink, Kafka, Airflow, or similar.
- Proficiency in at least one programming language (e.g., Python, Java, Scala).
- Experience with cloud platforms (AWS, GCP, Azure) and their data services.
- Familiarity with data warehousing concepts and technologies (e.g., Snowflake, Redshift, BigQuery).
- Understanding of data governance, data security, and data privacy principles.
- Excellent problem-solving, analytical, and communication skills.
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
Nice to have
- Experience with real-time data processing and streaming technologies.
- Familiarity with blockchain technology and cryptocurrency data.
