As a Staff Data Engineer, you will be a key contributor to the development of our next-generation data platform. You’ll be instrumental in designing, building, and maintaining robust and scalable data pipelines, ensuring data quality, and enabling insightful analytics. This role requires a strong understanding of data engineering principles, cloud technologies, and a passion for leveraging data to drive business value.
What You’ll Do:
- Design, develop, and maintain scalable and reliable data pipelines using cloud technologies (e.g., AWS, Azure, GCP) and big data tools (e.g., Spark, Flink, Kafka).
- Implement data governance best practices, ensuring data quality, security, and compliance.
- Collaborate with data scientists, analysts, and software engineers to understand data requirements and translate them into technical solutions.
- Develop and optimize data models for analytical and operational use cases.
- Monitor and troubleshoot data pipelines, ensuring timely and accurate data delivery.
- Stay up-to-date with emerging data technologies and recommend solutions to improve our data platform.
- Mentor junior data engineers and contribute to a culture of technical excellence.
What You’ll Bring:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in data engineering, with a strong focus on building and maintaining large-scale data platforms.
- Proficiency in programming languages such as Python, Scala, or Java.
- Extensive experience with cloud data platforms (AWS, Azure, GCP) and their respective data services (e.g., S3, Redshift, Snowflake, Data Lake, Databricks).
- Deep understanding of big data technologies (e.g., Spark, Flink, Kafka, Hadoop).
- Experience with data warehousing, data modeling, and ETL/ELT processes.
- Solid understanding of database systems (SQL and NoSQL).
- Excellent problem-solving, analytical, and communication skills.
- Experience with real-time data streaming and processing is a plus.
- Knowledge of machine learning concepts and MLOps practices is a plus.
