Data Engineer
Straive
IndiaPosted 5 days ago
Skill Required
IT JobsData EngineerCD pipelinesDatabricksKubernetesSparkPythondesignKafkaCI/CDGenerative AIETLandCICD
Role overview
Roles and Responsibilities Architect and maintain enterprise-grade ELT and ETL data pipelines using Python, PySpark, Kafka, and Databricks to manage large-scale risk data. Build and deploy GenAI agents utilizing Google ADK, Google Flash 2.5 LLMs, and Model Context Protocol (MCP) integrated with Human-in-the-Loop workflows. Design, automate, and deploy microservice integrations for data-intensive applications on OpenShift and Kubernetes using robust CI/CD pipelines.