Lead Data Engineer - Twine｜Meet.jobs

We’re hiring a Lead Data Engineer as we grow the team and execute on our ambitious product roadmap.

What you’ll be doing.

We are building something different: a product that leverages data and community to build the ultimate “knowledge engine” for HR. In this role, you’ll be responsible for owning and executing on an ambitious product roadmap across our data analytics and community products.

Decision Maker - Design, lead and implement ETL data pipelines that produce reliable data for all key Twine applications

Oversee effort to develop high-quality integrations with a range of HR Technology systems to support our core analytics application

Design, build, and launch new data models and data pipelines in production systems

Manage all aspects of dataset design, creation, and curation; including the frameworks to derive metrics to deliver data products for KPI’s, visualization

Build and own the automation and monitoring frameworks that showcase reliable, accurate, easy-to-understand metrics and operational KPIs to stakeholders for data pipeline quality and performance

Proactively identify reliability & data quality issues, and drive triaging and remediation process

Evaluate various technologies and platforms in open source and proprietary products. Execute proof of concept on new technology and tools to pick the best tools and solutions

If all goes well, your role will earn Twine respect as an innovation machine that's constantly pushing out new functionality at a breakneck pace - with each new feature giving never-before-seen superpowers to our customers.

Who we’re looking for.

We’re looking for a smart, hungry Engineer who is excited to grow and lead. You may be a good fit if:

You love data. We are a data analytics company first and foremost, and we are looking for people who are excited about different and unique data sets, and all the ways that they could be used in order to improve user experience.

You have a strong understanding of RDBMS concepts, data structures, and distributed data processing patterns.

You have experience with:

• Programming pipelines in languages like Python, etc;
• Big data technologies like Hadoop, Spark, Hive, Snowflake
• Data orchestration & scheduling tools like Airflow, etc.
• Cloud technologies like AWS, GCP, Containers, Kubernetes. (AWS preferred)
• DevOps technologies

You have a proven track record building products on production-grade systems

You have experience partnering with product owners and customer-facing teams to understand user requirements and design solutions that solve our most pressing business problems

B.S/M.S. in Computer Sciences or equivalent field, with 8+ years total experience and 6+ years of relevant experience within the big data/data warehousing domain