The vacancy is well-defined with clear expectations, but lacks comprehensive company information.
Job description
Our project involves a large data lake with complex scenarios for receiving and processing data from multiple sources. The project is at the start — no heavy legacy, plenty of space for technical experiments and optimal solution choices.
Responsibilities
- Lead a team of data engineers (code review, task assignment, development)
- Design data pipelines and infrastructure
- Develop and maintain parsers (PDF, doc, docx, xls, xlsx)
- Automate data processing and transformation
- Set up monitoring and debugging of pipelines.
Requirements
- Experience in team leadership (formal or informal) — code review, task assignment - at least 5 years
- Deep knowledge of Python and main libraries for data work (pandas, numpy, etc.)
- Experience in parsing/scraping complex semi-structured documents (PDF, doc, docx, xls, xlsx)
- Experience in building data pipelines using orchestrators like Dagster
- Understanding of data quality management
- Understanding of monitoring and debugging pipelines (logs, metrics, alerts)
- Knowledge of data formats: JSON lines, Parquet, XML, CSV
- Understanding of data acquisition/delivery methods: S3, REST API, SOAP, RPC
- Proficient in PostgreSQL
- Git — branching, review, merge strategies
- English — reading technical documentation.
About ООО "ОДСС"
OOO 'ODSS' (Open Data Systems & Solutions) specializes in software development, data engineering, collection, processing, analysis of data, digital archiving, and custom development. They focus on open data technologies, creating information portals for government, public organizations, and citizens, and conduct research on government and societal openness. Primary activity is computer software development, with tools like CKAN and Omeka S.