Crypto Data Engineer (Hyderabad- Remote)
Astra DAO is currently in search of a versatile Big Data Engineer to support the operations of our Data Scientists and Engineering team. The role involves leveraging various tools and methods to develop frameworks for data processing utilizing SQL, Python, R, Java, and C++. The ideal candidate will utilize machine learning techniques to establish and maintain structures for data analysis while staying knowledgeable about current programming and deployment approaches in the industry. Collaboration with colleagues is essential to ensure alignment with project requirements throughout the process.
Responsibilities
- Collaborate with team members and clients to clarify task requirements.
- Design and set up infrastructure for accessing and analyzing big data.
- Enhance existing frameworks to improve efficiency.
- Test structures for usability and functionality.
- Construct data pipelines from diverse sources such as API, CSV, JSON, etc.
- Prepare raw data for utilization by Data Scientists.
- Implement effective data validation and reconciliation methods.
- Maintain backups and share work with relevant team members.
- Stay informed about industry standards and technological advancements for enhanced output quality.
Requirements
- Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or relevant discipline.
- A Master's degree in a related field is advantageous.
- 3+ years of experience in Python, Java, or other programming languages.
- 3+ years of SQL & No-SQL experience (experience with Snowflake Cloud DW & MongoDB is a plus).
- Proficient in schema design and dimensional data modeling.
- Expertise in SQL, No-SQL, Python, C++, Java, and R.
- Skilled in building Data Lake, Data Warehouse or similar structures.
- Proficient in AWS Cloud services.
- Strong analytical and problem-solving abilities.
- Ability to work independently and collaboratively.
- Effective task management skills with minimal supervision.
About Astra DAO
Astra DAO is an automated crypto asset allocator, operating on Ethereum to offer advanced investment strategies to retail investors. The platform aims to simplify passive investing for retail participants by providing Crypto Indices. Astra DAO endeavors to enable crypto investors to compete with quantitative investment funds by identifying successful investments and trades through its innovative model incentivizing index investors, creators, and token holders.