Senior DataOps Engineer - MainApp infrastructure
We are seeking a skilled individual to join our dynamic team responsible for designing, developing, maintaining, and enhancing software for various adjacent ventures projects. These projects are rapidly bootstrapped with a lean team. Your role will involve active participation in the design of different components supporting scalable applications, ranging from frontend UI to backend infrastructure.
Responsibilities:
- Oversee the day-to-day operations of Hadoop, Spark, Flink, Clickhouse, and other big data platforms to ensure system stability and data security.
- Administer and manage Linux systems, demonstrate proficiency in common commands, and possess scripting abilities in Shell, Python, or similar languages.
- Manage big data components on cloud platforms (AWS/GCP/Azure) and have hands-on experience with container technologies like Kubernetes and Docker.
- Develop and maintain monitoring systems to monitor platform performance, optimize configurations, allocate resources efficiently, and troubleshoot performance issues using tools like Datadog, Prometheus, Grafana, and Zabbix.
- Deploy, upgrade, and scale core big data components including Flink, Kafka, Spark, Impala, Clickhouse, and Kudu.
- Produce and update technical documentation for operations, and contribute to platform solution design and upgrades.
- Research and incorporate new technologies to enhance operational processes and offer technical guidance to help client teams enhance their capabilities.
- Preferred: Experience in developing n8n workflow.
Qualifications:
- Knowledge of CDH/CDP/HDP or similar Hadoop distributions with proven experience in big data platform operations is preferred.
- Proficient in Linux administration and scripting languages such as Shell, Python, or equivalent.
- Experience working with major cloud platforms (AWS/GCP/Azure) and containerized environments (Kubernetes, Docker).
- Strong understanding of big data components and proficiency in performance tuning to independently address stability and scalability issues.
- Excellent technical writing and communication skills to support documentation and deliver solutions effectively.
- Motivated to explore new technologies, apply innovative approaches to optimize operations, and drive efficiency.
Benefits:
- Competitive salary
- Attractive annual leave entitlement including birthday and work anniversary celebration
- Flexible work hours and hybrid or remote setup
- Internal mobility program for career advancement opportunities
- crypto.com visa card provided upon joining
About Us:
Founded in 2016, we serve over 80 million customers and are the world's fastest-growing global cryptocurrency platform. Our commitment is to accelerate cryptocurrency adoption through innovation while empowering the next generation of builders, creators, and entrepreneurs in developing a fairer digital ecosystem. We value diversity and inclusion, aiming to have a team with varied backgrounds, perspectives, and skills to strengthen our mission.
Note:
Personal data submitted by applicants will be used solely for recruitment purposes. Please be advised that only shortlisted candidates will be contacted.
