Senior Data Processing Engineer (Python, Back-end, Remote) - Leadbook|Meet.jobs

薪資

20m - 40m IDR Monthly

技能需求

    工作機會描述

    Job description & requirements

    Senior Data Processing Engineer (Python, Backend, Remote) 

    About Leadbook

    Leadbook is the game-changing Marketing Tech Platform for Lead Generation, powered by Artificial Intelligence, Data-Mining and Social Networks. We aggregate data from the Internet to create a customer intelligence database with millions of verified contacts, generate leads with our proprietary email campaigns infrastructure and recommend new opportunities with predictive analytics.

    Job Overview

    We are looking for an experienced backend engineer to help us advance our data acquisition and processing pipelines. If you are an outstanding Python engineer who is enthusiastic about problem solving, learning new technologies and enjoys challenges, we are interested in talking to you.

    Responsibilities

    • Design and develop a highly scalable, end to end pipeline, to acquire, consume, integrate and analyze large volumes of complex data.
    • Improve quality of data and ingest data from several data sources using different data processing techniques.
    • Develop creative ideas on how to work better and smarter. Influence and participate in top-priority projects that have a real impact.

    Qualifications

    • BA/BS degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.
    • Strong in design patterns, data structures, and algorithms using python (3+ years exp)
    • Ability to observe best engineering practices to write optimized, maintainable and bug-free code.
    • Understanding of common internet protocols, such as HTTP, DNS, SMTP.
    • Min 1 year experience with web crawling frameworks (Scrapy, BeautifulSoup, Selenium)
    • Min 2 years of working experience in any big data technology, such as MongoDB, Kafka, Elasticsearch.

    Good to have

    • Exposure to cloud-native technologies such as docker, Kubernetes.
    • Intimate knowledge of data validation, cleaning, enrichment and ETL techniques.

    Leadbook