发布时间:2025年01月14日
岗位职责与任职要求
1. Work with cross-functional teams to deliver data engineering projects, from development, deployment though to support in ensuring high availability and performance.
2. Design and implement scalable and secure data analytics solutions for data ingestion, data processing, data visualization etc..
3. Collaborate with stakeholders to deliver data platform capabilities, prioritizing requirements basing on business benefits and protection against data risks.
4. Promote compliant and quality reuse of data on enterprise platform, through incremental delivering functionalities in data lifecycle, including data access control, data lineage, data modelling, data quality and data analytics.
5. Apply native cloud skills like container, object storage etc. to enable effective data analytics, data management and data governance.
Manage development pipeline thru Develops, CICD tooling and Infrastructure as Code.
6. Bachelor’s degree in computer science, technology, data or related disciplines
7. 5 years of working experience in systems development, preferably having track record in large enterprises. Senior position will require stronger technology and management experiences.
8. Experienced in Agile methodologies in a cross-functional teams
9. Good understanding of enterprise data architecture and technology stack, covering batch processing and streaming data for analytics usage.
10. Familiar with cloud technology and operations in AWS, Azure or China clouds and data processing in a cloud environment.
11. Proficiency in programming languages such as Python, Java, C++ or Scala
12. Hands-on experience with big data technologies and ecosystems, including Hadoop, Spark, Flink,and Kafka.
13. Knowledge of database systems, both relational and NoSQL.
14. Familiar with big data technologies, e.g., Redshift, HDFS, HBase, Hive etc.
15. Experience in data security and data management tools, e.g., LDAP, OAuth, Keycloak, Lake Formation etc.
16. Experienced in DevSecOps tolling, CI/CD pipeline, Terraform etc
17. Excellent influencing skills with good command of written and spoken English.