Senior Platform and Data Engineer
About the Role:
As a Senior Platform and Data Engineer, you will play a key role in enhancing, crafting, and deploying our data infrastructure while collaborating within the platform engineering team to develop scalable chain-data processing solutions.
Your primary objective will be to efficiently aggregate data from diverse sources into a unified, actionable dataset that can benefit our users effectively.
In this position, you will report to our Head of Data and Analytics and contribute to refining and streamlining our existing data system to accommodate an expanding range of product and blockchain data. As our team grows, you are expected to lead a group of data engineers.
Given the size of our organization, this role requires hands-on involvement, working closely with our engineers to achieve objectives.
The data system you will architect is indispensable to the entire company, marking this as a high-impact role offering significant autonomy within a supportive team. This opportunity allows you to shape a fundamental element of our web3 stack in steering the future of the internet.
Responsibilities:
- Ensure alignment across all teams by consolidating data from a centralized source.
- Collaborate with existing systems within GCP, Clickhouse, and dbt to enhance them, focusing on data integrity to transform multiple data sources into accurate, useful formats.
- Automate as much of the data processing pipeline as possible.
- Address data discrepancies swiftly and effectively.
- Scale our data capacity by 10x in the upcoming 2-3 years.
- Establish data monitoring and tooling in Go and Typescript to enable all engineers to assess products utilizing client libraries.
- Devise data backup and recovery protocols to maintain data integrity.
- Ensure data is easily interpretable and actionable using BI tools such as Looker or Superset within an acceptable timeframe (real-time, daily, monthly, yearly).
- Lead and mentor a small team of data engineers in roadmap planning, design aspects, and implementation.
Requirements:
- 5+ years of relevant industry experience in platform or data engineering.
- Proficiency in Golang.
- Strong proficiency in at least one data warehouse solution like Snowflake, Redshift, or Clickhouse.
- Ability to collaborate effectively with cross-functional teams and stakeholders.
- Strong programming skills with a focus on quality.
- Willingness and capability to learn quickly about blockchain technology, its data structures, schema, and ecosystem.
- Proficient in SQL and experienced with ETL processes using tools like dbt.
- Background in distributed log systems like Kafka and Spark is advantageous.
- Expertise in working with large software systems in major cloud platforms like AWS, GCP, or Azure.
- Solid understanding of building fault-tolerant, scalable systems.
- Experience in blockchain data operations is beneficial.
- Interest in web3 technology and its advancement.
Why Horizon:
- Opportunity for significant impact in a dynamic, rapidly-growing organization.
- Engage with challenging and impactful problems that have the potential to reshape industries.
- Competitive compensation package inclusive of equity.
- Opportunities for career acceleration within an early-stage environment.
- Contribute to defining web3 and pioneering the future of the internet.
- Collaborate with a diverse, experienced team across various domains.
- Emphasis on work-life balance opposed to traditional "crunch" culture found in larger companies.
- Benefit from robust benefits packages tailored for employees.
- Commitment to mental health wellbeing and modernized vacation policies.
- Investments in personal development for all team members.
Horizon is dedicated to fostering diversity and encourages applicants from diverse backgrounds, regardless of gender or faith. Our commitment to enriching our team is a cornerstone of attracting talented individuals from various disciplines whose unique experiences contribute to their work.