We are seeking a highly capable Data Engineer to join our team. The successful candidate will be responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. The primary responsibility will be to prepare data and provide it to customised Large Language Models (LLMs) including OpenAI and custom models trained by our company.
Key Responsibilities:
- Develop and maintain data architectures, data platforms, and databases.
- Create and implement complex data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights.
- Collaborate with Data Scientists and DevOps engineers to build, optimize, and manage our data pipeline architecture.
- Work closely with all teams to assist with data-related technical issues and provide data-driven solutions.
- Ensure data architecture will support the requirements of the business.
- Work with the team to strive for greater functionality in our data systems.
- Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Qualifications:
- Proven experience as a Data Engineer or in a similar role.
- Technical proficiency with scripting languages such as Python, SQL, and experience with cloud services and tools.
- Experience with databases (SQL and NoSQL), ETL frameworks, and data stream processing.
- Strong analytical skills, attention to detail, and problem-solving aptitude.
- Experience with AI/ML and familiarity with OpenAI and similar platforms is a strong advantage (but not mandatory).
- Excellent communication and collaboration skills.
What We Offer:
- The opportunity to contribute to a ground-breaking product in the realm of Human Transformation.
- An inclusive, dynamic, and forward-thinking work environment.
- Continuous learning and professional development opportunities.
.svg){kind=logo}