Experienced Data Engineer AI & Big Data
תיאור המשרה
This team is responsible for developing advanced analytics and presenting insights from data, developing Machine Learning and NLP models, extracting text from documents, developing Big Data processes in the Hadoop environment over Spark and KAFKA, including working with data structures such as JSON and Parquet, a graphical database, and more.
The role includes:
Professional team leadership (not team management) including performing CODE REVIEW
Use as a SCRUM MASTER - managing and planning tasks for team members
Working closely with Data Scientists on the team to develop panels for Machine Learning models in the medical field.
Data modeling and application design in the Big Data field
Development of real-time data processes.
Performing basic analysis on data.
Job Requirements:
Academic education in the field of - Software Engineering/Computer Science - required
Four years or more of work experience in Python and SQL development - required
Two years or more of work experience with HDFS, Hive, Spark, Kafka - required
Experience in non-relational databases such as Elastic, Neo4J.
Experience in developing and designing ETL processes - an advantage
The position is open to both men and women.
דרישות התפקיד
.