Senior Data Engineer - Trading Analytics
The trading team responsible for handling various crypto products seeks a Senior Data Engineer proficient in ClickHouse and AWS infrastructure to join the active Trading Analytics team. This role focuses on supporting data engineering requirements for trading, middle office, and trade capture systems. The ideal candidate should have a strong Python background for ETL tasks, expertise in AWS cloud services, and familiarity with data orchestration tools like Airflow and Kafka. Experience in trading, crypto, or middle office settings is highly desirable.
Key Responsibilities:
- Design, deploy, and manage scalable ClickHouse infrastructure for handling large datasets to ensure optimal performance, availability, and sustainability.
- Develop robust ETL pipelines with Python for data ingestion, manipulation, and storage.
- Collaborate with infrastructure teams for the proper setup of various AWS components such as EC2, S3, RDS, Lambda, and others.
- Establish and maintain data orchestration flows using Airflow and integrate Kafka for real-time data processing.
- Coordinate with cross-functional teams like trading, risk management, and middle office to align data infrastructure with business requirements.
- Enhance the performance and scalability of data pipelines, ensuring data accuracy and integrity.
- Monitor and resolve issues within the data infrastructure, following best practices for data governance and security.
- Guide junior engineers and provide technical leadership within the team.
Qualifications:
- Over 8 years of experience in data engineering, focusing on constructing and managing large-scale data systems.
- Proficient in setting up and using ClickHouse infrastructure.
- Strong proficiency in Python, specifically for ETL pipelines and data workflows.
- In-depth understanding of AWS infrastructure components, including networking, storage, compute, and security.
- Experience in data orchestration and workflow automation with Airflow.
- Knowledge of Kafka for establishing real-time data pipelines.
- Exposure to trading, crypto, middle office, or trade capture systems is a significant advantage.
- Familiarity or experience with machine learning and AI is a plus.
- Strong problem-solving abilities, attention to detail, and adeptness at working under pressure in fast-paced environments.
Preferred Skills:
- Experience in financial services, particularly in trading or crypto sectors.
- Ability to collaborate with diverse stakeholders, gather requirements, and deliver solutions that meet business needs.
- Knowledge of database optimization, query performance tuning, and monitoring tools.
Life at Crypto.com:
- Empowered to explore new opportunities while working with a talented and supportive team.
- Proactive working environment emphasizing innovation and thoughtful solutions.
- Focus on personal and professional growth through skill development.
- Collaborative culture promoting teamwork and support among colleagues towards shared goals.
Benefits:
- Competitive salary.
- Comprehensive medical insurance coverage including dependents.
- Generous annual leave entitlement.
- Flexibility in work arrangements and hybrid or remote setups.
- Internal mobility program offering diverse career paths.
- Work perks, including a Crypto.com visa card provision.
- Region-specific benefits packages.
About Crypto.com:
Founded in 2016, Crypto.com serves a vast customer base and is a rapidly expanding global cryptocurrency platform, committed to cryptocurrency adoption through innovation. The platform values diversity and inclusion, seeking candidates to strengthen its team with various backgrounds, perspectives, and skills.
Applicants' data will be solely used for recruitment purposes.