EyeEm is the world's premier photography community and platform. It's a place for photographers of all abilities to share, interact, and learn more about taking pictures on any device. Thanks to a unique combination of advanced search technology, Market and Missions, EyeEm photographers have a chance to showcase their original work and license their photography to be seen by a global audience.
EyeEm is searching for a Data Engineer to join our cutting-edge Engineering team. As a data engineer, you’ll be responsible for maintaining a pipeline that receives data from production systems, stores it, and makes it available to internal consumers. You’ll develop batch and near real-time frameworks to ingest and process data. As part of cross-functional projects, you’ll be the glue that holds together different areas ranging from application development to data infrastructure. Key responsibilities include (but are not limited to):
- Design, build, and maintain data ingestion, ETLs and infrastructure for batch and near real time processing.
- Design and maintain events for all of our different products.
- Develop and maintain logging infrastructure, processing and archival for infrastructure analytics.
- Build data stores to aggregate, denormalize and serve data about our entities.
- Participate in rotating on-call duty.
REQUIREMENTS
- You love data and crafting methods to make sense of it.
- You are a self-driven and fast learner, and eager to work with new technologies.
- You are a team player and motivate yourself and people around you to improve each day.
- You can structure and organize your work easily.
- You are quality-oriented and detail-focused.
- A technical degree or relevant work experience
- Extensive Scala skills
- Knowledge of both relational and non-relational databases and their respective models
PREFERRED
- Familiarity with the Hadoop ecosystem, plus distributions like Cloudera, MapR or Hortonworks
- Extensive Python skills
- Extensive experience with Cassandra and/or HBase
- Experience with Apache Flume as a way to move large amounts of log data
- Familiarity with data-loading techniques on Amazon Redshift
BENEFITS
- A work environment where you can develop your skills and learn from the best
- An international team that is highly motivated and fun to be with
- Ability to have a significant impact on our product and community
- Free onsite German lessons, focusing on using German beyond the workplace
- A smooth onboarding experience to help give you the perfect start