Data Engineer - Shopline 商線科技有限公司｜Meet.jobs

【What you’ll be doing】 
- Develop, operate, and monitor ETL for data collection, cleansing, processing, storage, and analytics
- Responsible for data schema management and db performance tuning
- Develop backend APIs and maintain data visualization platform for SHOPLINE merchants

【 What Are we looking for? 】
- Fluent in Python and SQL, experience in api framework (Flask, FastAPI, Django) is a plus
- Expertise in hands-on ETL job design and development (Airflow preferred)
- Proficient in SQL and NoSQL databases, experience in PostgreSQL / MongoDB is a plus
- Experience in working with cloud services such as AWS / GCP, data related services preferred
- Knowing how to work with big data tools or stream-processing system, such as Hadoop, Kafka, Spark-streaming, etc
- Familiar with Linux/Unix environments, developed with Docker / Kubernetes
【 Bonus Qualifications 】
- Use existing ML algorithms to solve the real world problems
- Familiar with the e-commerce industry and rich experience in data analysis