All vacancies
VK

Lead Data Engineer

VK · hybrid · lead · full-time
aitech PythonAirflowSparkHadoopClickHouse
5.9
AI Score
The vacancy is well-defined but lacks compensation details, affecting overall quality.
Job description
VK is looking for a Lead Data Engineer to develop and maintain data processing and delivery processes for analytics and ML teams.
Responsibilities
### Responsibilities - Develop and maintain data processing and delivery processes for analytics and ML teams - Build data marts and optimize - Write ad-hoc queries and exports, debug - Gather requirements
Requirements
### Requirements - Understanding of parallel computing on a cluster - Experience with Airflow, Spark, Hadoop, ClickHouse, YT (optional) - Knowledge of Python: basic algorithms (for understanding optimal code), classes and other complex code (for reading source code and creating utilities like operators/services) - Knowledge of Git and teamwork (code review)
About VK
VK (formerly Mail.ru Group) is a Russian technology company that operates VKontakte, the largest European social network with over 100 million active users. The company provides a diverse ecosystem of services including social networking, email, e-commerce, cloud services, music streaming, video platforms, and business solutions.
Social Media, Internet Services, SaaS · 1000+ · Saint Petersburg, Russia · Founded 1998 · https://team.vk.company/vacancy/45275/
Apply to this role