Data Engineer - Shopee Singapore Pte Ltd|Meet.jobs

Salary

4K - 8K SGD Monthly

Required skills

    Job description


    Job Description:

    • Design and grow the Shopee data platform to support a variety of big data applications using open-source technologies including Kafka, Hadoop, Presto, HBase, Spark, Hive, Druid, and our own creations. Some examples include a real-time data streaming platform, a unified query platform, a cluster management system, and a machine learning platform
    • Design and grow Shopee’s data warehouse, build reliable and smart ways to ingest data to the warehouse, and help engineer efficient data pipelines. Some examples include self-service data ingestion systems, Airflow-enabled workflows with code-as-configuration, and data validation tools
    • Build critical data marts and applications to support products and solve specific business needs, design data models for optimal storage and retrieval, and optimize data architectures to meet critical product and business requirements. Some examples include a real-time Campaign Mart (used to serve the business with live intelligence) and Order Mart (to supply low latency seller performance system)

    Requirements:

    • B. Sci. / Ms / PhD in Computer Science or a related technical field
    • 2+ years of working experience in software development in at least one of these languages: Java, Scala, Python, C/C++, under Linux / Unix. Scala is a plus
    • Familiar with SQL; strong scripting ability in Bash is a plus
    • Familiar with Hadoop, Spark, Kafka, Presto, and other big data experience is a plus
    • Familiar designing and operating of a robust distributed system is a plus
    • Love to use and develop open-source technologies
    • Excited to work intimately with data
    • Passionate, self-motivated, and takes ownership

    Shopee Singapore Pte Ltd

    shopee is the largest eCommerce platform in Southeast Asia and Taiwan. It is a platform tailored for the region, making online shopping easy, secure and fast through its strong payment and logistical support.

    Other jobs from this employer

    Senior UI/UX Designer

    4K - 8K SGD Monthly

    • Featured
    • designing web / mobile products
    • ,
    • e-Commerce products (mobile and web)

    Software Engineer - Web-Backend

    5K - 8K SGD Monthly

    • Featured
    • Python + Django/Flask
    • ,
    • django
    • ,
    • Ruby on Rails
    • ,
    • Node.js
    • ,
    • HTTP
    • ,
    • data structures
    • ,
    • Web Service frameworks

    UI/UX Designer

    4K - 8K SGD Monthly

    • Featured
    • Sketch
    • ,
    • Adobe Photoshop
    • ,
    • Adobe Illustrator
    • ,
    • Flinto
    • ,
    • Principle

    Software Engineer - Server

    5K - 8K SGD Monthly

    • Featured
    • data structures and algorithms
    • ,
    • operating systems
    • ,
    • networks
    • ,
    • database
    • ,
    • Python
    • ,
    • C++ and Java
    • ,
    • TCP
    • ,
    • UDP
    • ,
    • HTTP

    Product Management - Marketing / Promotion

    4K - 8K SGD Monthly

    • Featured
    • Product Management

    Software Engineer - Mobile App (Android)

    5K - 8K SGD Monthly

    • Featured
    • Android
    • ,
    • Mobile Browser

    Technical Project Management (Software Application)

    4K - 8K SGD Monthly

    • Featured

    Software Engineer - TechOps/ DevOps

    5K - 8K SGD Monthly

    • Featured

    Software Engineer - ReactNative

    5K - 8K SGD Monthly

    • Featured
    • React native
    • ,
    • ios
    • ,
    • Android
    • ,
    • Mobile Browser
    • ,
    • React.js
    • ,
    • FLOW
    • ,
    • npm
    • ,
    • babel
    • ,
    • ESLint
    • ,
    • Flow Type Check
    • ,
    • Jest Unit testing

    Product Management - Consumer, Product & Technology

    4K - 8K SGD Monthly

    • Featured

    Product Management - Search

    4K - 8K SGD Monthly

    • Featured

    Product Management - Recommendation

    4K - 8K SGD Monthly

    • Featured

    Business Product Management (Supply Chain Management)

    4K - 8K SGD Monthly

    • Featured

    Product Management - Payment (Digital Products)

    4K - 8K SGD Monthly

    • Featured

    Product Management – Paid ads

    4K - 8K SGD Monthly

    • Featured

    Product Management - Data Products

    4K - 8K SGD Monthly

    • Featured

    Product Management - Order, Consumer Experience and Platform

    4K - 8K SGD Monthly

    • Featured

    Software Engineer - Platform Engineering

    5K - 8K SGD Monthly

    • Featured

    Product Management - Fraud/ Risk Control

    4K - 8K SGD Monthly

    • Featured
    • Product Management

    Senior User Researcher

    4K - 8K SGD Monthly

    • Featured
    • User Research
    • ,
    • SQL

    Country Product Manager

    4K - 8K SGD Monthly

    • Featured
    • Product Management

    Software Engineer - Machine Learning

    5K - 8K SGD Monthly

    • Featured
    • Go
    • ,
    • Python and C++
    • ,
    • clustering
    • ,
    • classification algorithms
    • ,
    • Tensorflow
    • ,
    • scikit
    • ,
    • Hadoop
    • ,
    • Spark
    • ,
    • Map-Reduce
    • ,
    • Linux
    • ,
    • shell script

    Database Engineer

    5K - 8K SGD Monthly

    • Featured
    • MySQL
    • ,
    • Shell/Python/Perl/Ruby
    • ,
    • Linux

    Software Engineer - Web-Frontend

    5K - 8K SGD Monthly

    • Featured
    • JavaScript
    • ,
    • React UI framework
    • ,
    • React
    • ,
    • HTML/CSS/Javascript/Django