Requirements
### Requirements:
- Project: Retail.
- General understanding of Lakehouse technology stack.
- Understanding the difference between Big Data/Lakehouse and regular-sized data.
- Knowledge of SQL (indexes, functions, optimization, performance profiling).
- Knowledge of programming languages (JAVA, Python).
- Experience with relational databases (Oracle, Postgres, MySQL, MsSQL, etc.).
- Ability to work with Git (knowledge of git pull/commit/push commands).
- Experience with DBT, Cosmos, Ni-Fi.
- Experience in development with Spark.
- Skills in using components of the Hadoop ecosystem: Yarn, Ranger, Zookeeper, Hive metastore.
- Understanding the features of Trino.
- Understanding data formats Iceberg, Parquet, Avro.
- Understanding how to work with minio or any other S3-based storage.
- Experience using project management and documentation systems.
- Experience in developing atypical integrations (including SAP systems).
- Experience in developing near-realtime streams (Flink, Debezium).
- Experience optimizing high-load streams (billions of incremental records) using Observability tools (Grafana, Victoria metrics, Zabbix).