Data Platform Engineer
About Messari
Messari is a renowned provider of crypto market intelligence products designed to empower professionals navigating the crypto/Web3 landscape with confidence. By combining a global research database with a comprehensive suite of data visualization and asset discovery tools, Messari brings transparency and sophisticated qualitative and quantitative analytics to the industry.
The name "Messari" is inspired by the Franciscan monks advocating for "clean books" during the Renaissance, which emphasized proper accounting methods for ethical business practices. The company aims to provide reliable information to enhance participation in the crypto ecosystem for participants, investors, builders, platforms, and other stakeholders.
The Position
Messari is currently searching for a skilled Data Platform Engineer to join its team. In this role, you will be responsible for the development and maintenance of scalable data pipelines, managing a robust data platform infrastructure, and implementing DevOps best practices to ensure analysts access data seamlessly.
This is a full-time position, and remote candidates are welcome. The company operates remotely with a globally distributed team and fosters a conducive environment for productive remote work.
Responsibilities
- Create and maintain scalable data pipelines using tools like DBT and Airflow/Dagster.
- Design and oversee a resilient data platform infrastructure for optimal availability and performance.
- Collaborate with data engineers and analytics engineers to enhance data models and streamline data workflows.
- Implement DevOps best practices, including CI/CD pipelines and automated data solution testing.
- Deploy efficient containerization technologies such as Docker and Kubernetes for platform component deployment and scaling.
- Monitor and troubleshoot platform issues to ensure smooth data ingestion and processing.
- Collaborate closely with the data science and analytics teams to enable efficient data access and integration.
Requirements
- Background in data engineering with a focus on managing data platform architecture.
- Proficiency in utilizing DBT and Apache Airflow for orchestration and data transformation.
- Strong grasp of DevOps practices, specifically CI/CD, infrastructure as code, and observability.
- Knowledge of data warehousing, ETL frameworks, and data governance principles.
- Robust problem-solving skills with a proactive approach to identifying and resolving platform issues.
- Effective communicator capable of thriving in a collaborative, cross-functional setting.
Bonus Experience
- Snowflake data warehouse platform
- Dagster for data orchestration
- Pulumi for infrastructure as code
- AWS services such as S3, SNS, SQS, Lambda
Compensation
- Salary Range $120,000 to $180,000 (Tier 1 USA)
