Data Engineer

Job summary
GFT Italia is looking for a Big Data Engineer for Cross Market projectsData Management, Data Platform implementation, and documentationExperience with GCP, data structures, distributed processing, and Scala/Java
Job seniority: mid-to-senior level
Responsibilities
• Manage Data Management phases, including data ingestion, modeling, and processing• Implement Data Platform on premise or in the cloud following best architectural practices• Document functional requirements, system specifications, and project specifications
Requirements
• Experience with GCP (Google Cloud Platform)• Knowledge of data structures: HDFS, Apache Hive, Impala, Kudu, HBase• Experience with distributed processing: Apache Spark, Spark Streaming• Experience with event-driven processing: Apache Kafka, Flink• Knowledge of Apache Nifi (or Cloudera Flow Management) for pipeline design and orchestration• Proficiency in Scala/Java and SQL for data querying
Key Skills Needed
• GCP (Google Cloud Platform)• Data structures: HDFS, Apache Hive, Impala, Kudu, HBase• Distributed processing: Apache Spark, Spark Streaming• Event-driven processing: Apache Kafka, Flink• Apache Nifi (or Cloudera Flow Management) for pipeline design and orchestration• Scala / Java• SQL