Data Engineer_1

Build data systems and pipelines using Apache Flink (or similar) pipelines. Understand various raw data input formats, build consumers on Kafka/ksqldb for them and ingest large amounts of raw data into Flink and Spark. Conduct complex data analysis and report on results. Build various aggregation streams for data and convert raw data into various logical processing streams. Build algorithms to integrate multiple sources of data and create a unified data model from all the sources.