We are seeking a highly skilled and experienced Data Engineer II to join our Generative AI – Music team. In this role, you will be responsible for designing, building, and maintaining robust and scalable data pipelines to support our innovative Gen AI music initiatives.
What you’ll do:
- Design, build, and maintain robust and scalable data pipelines for Generative AI Music initiatives.
- Collaborate with machine learning engineers and researchers to understand data requirements and implement efficient data solutions.
- Develop and optimize data models to support the training and deployment of Gen AI models.
- Implement data quality checks and monitoring to ensure the accuracy and reliability of data.
- Work with large-scale datasets, utilizing technologies such as Spark, Flink, Kafka, and big data platforms.
- Ensure data governance and compliance with relevant regulations and policies.
- Contribute to the continuous improvement of data engineering best practices and tooling.
- Debug, troubleshoot, and resolve data-related issues in a timely manner.
- Document data pipelines, schemas, and processes clearly and comprehensively.
Who you are:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 3+ years of professional experience in data engineering, with a focus on building and maintaining large-scale data pipelines.
- Strong proficiency in programming languages such as Python or Scala.
- Expertise in big data technologies (e.g., Spark, Flink, Hadoop, Kafka).
- Experience with cloud platforms (e.g., GCP, AWS, Azure).
- Solid understanding of data warehousing concepts, ETL processes, and data modeling.
- Familiarity with machine learning concepts and MLOps practices is a plus.
- Excellent problem-solving, analytical, and communication skills.
- Ability to work effectively in a fast-paced, collaborative environment.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
