Dataforest is looking for a Data Engineer to join an interesting software development project in the field of Cybersecurity. Our client's platform offers Identity Insights drives real-time, multi-contextual digital forensics to protect new account opening workflows and expose fake accounts already in a customer database.<\/p>\n
You'll be a great fit if you have:<\/p>\n
– 3+ years of hands on in data engineering;
– 3+ years of commercial experience with Python;
– Advanced experience with SQL DBs (optimisations, monitoring, etc.);
– Advanced experience with PySpark;
– Solid understanding of ETL principles (architecture\/ monitoring\/ alerting\/search and resolve bottlenecks);
– Familiar with AWS infrastructure (boto3, S3 buckets, etc);
– Experience working with large volumes of data;
– Understanding the principles of medallion architecture.<\/p>\n
Would be a plus:<\/p>\n
– Cassandra\/Scylla
– PostgreSQL
– Pandas
– Experience with Kafka and Redis<\/p>\n
What you'll do:<\/p>\n
– Maintain data processing architecture using Python and PySpark that interacts with ScyllaDB & PostgreSQL.
– Work with Databricks infrastructure to ensure reliability, scalability, and cost efficiency.
– Proactively identify bottlenecks and suggest technical improvements.<\/p>\n
We ensure your growth with:<\/p>\n
– Working in a fast-growing company;
– Great networking opportunities with international clients, challenging tasks;
– Personal and professional development opportunities;
– Competitive salary fixed in USD;
– Paid vacation and sick leaves;
– Flexible work schedule;
– Friendly working environment with minimal hierarchy;
– Team building activities, corporate events.<\/p>\n","protected":false},"excerpt":{"rendered":"
Dataforest is looking for a Data Engineer to join an…<\/p>\n","protected":false},"author":2236,"featured_media":0,"parent":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"_mo_disable_npp":"","rwu_salary_min":0,"rwu_salary_max":0,"rwu_salary_currency":"","rwu_salary_period":"","rwu_english_level":"B2","rwu_experience_months":36,"rwu_candidate_countries":"\u041a\u0440\u0430\u0457\u043d\u0438 \u0404\u0432\u0440\u043e\u043f\u0438 \u0442\u0430 \u0423\u043a\u0440\u0430\u0457\u043d\u0430","rwu_company_type":"","rwu_industry":"ml","rwu_part_time":false,"rwu_source_views":476,"rwu_source_applications":39,"rwu_source_category":"Data Engineer","rwu_source_name":"Djinni.co","rwu_source_url":"https:\/\/djinni.co\/jobs\/824385-middle-data-engineer\/"},"job_category":[57],"job_type":[54],"class_list":["post-4031612","job","type-job","status-publish","hentry","job_category-programuvannia","job_type-povna-zainiatist"],"yoast_head":"\n