Software Integrations Developer
GP Strategies Corporation
IndiaremotePosted 1 month ago
Skill Required
Software-Integrations-DeveloperData-EngineerAzure-DeveloperIntegration-DeveloperData-Platform-DeveloperSoftware-Integration-DeveloperIntegrations-DeveloperSoftware-Integration-SpecialistSoftware-Integration-EngineerSystems-Integration-DeveloperSoftware EngineerSoftware DeveloperQuery Optimizationdata engineeringDesign PatternsServerlessAzureData WarehousingPower AppsCD pipelinesEngineeringDatabricksPower BIdesigninganalyticsRESTsecuritybuildingSparkPythondesignDevOpsVaultCI/CDOAuthAgileAPIsFulltime
Key highlights
- 5+ years of experience in Data Engineering / Data Platform development
- 3+ years of hands-on experience with Azure Databricks
- Opportunity to lead modern data platform strategy
- Work with Azure, Databricks, and emerging AI capabilities
- Strong executive visibility and influence
- High-impact role in analytics, AI, and digital transformation
Role overview
The Software Integrations Developer will architect connectivity within the digital ecosystem, designing, developing, and maintaining robust integration solutions to ensure seamless data flow and high-performance processing. Leveraging the Microsoft Azure stack, this role transforms complex business requirements into scalable, automated integration workflows that drive organizational efficiency. The position offers the opportunity to lead and shape the organization's modern data platform strategy, particularly around Azure and Databricks adoption, while working on high-impact data initiatives enabling analytics, AI, and digital transformation programs.
Responsibilities
- Design and implement end-to-end data pipelines (batch and streaming) using Azure Data Factory / Synapse Pipelines and Databricks.
- Develop scalable ETL/ELT workflows using PySpark, SQL, and Databricks notebooks to process large-scale datasets efficiently.
- Build and optimize data ingestion frameworks for structured and unstructured data from multiple enterprise and external sources.
- Lead the design and implementation of Databricks-based lakehouse architecture, including Delta Lake and medallion (bronze, silver, gold) data layers.
- Optimize Spark jobs for performance, scalability, and cost efficiency, including partitioning, caching, and cluster tuning.
- Implement data versioning, incremental processing, and ensure high data quality, consistency, and governance standards.
- Utilize Azure services such as Data Factory, Data Lake Storage, Synapse Analytics, and Key Vault to build secure, scalable data solutions.
- Design, build, and maintain integration solutions using Azure Functions, Logic Apps, and Service Bus / Event Grid to connect line-of-business applications, SaaS platforms, and external services with the data platform.
- Develop and expose secure, well-documented REST APIs and event-driven endpoints, handling publishing, versioning, throttling, and authentication through Azure API Management.
- Implement reliable, decoupled event-driven and near-real-time integration patterns using Event Hub, Event Grid, and Service Bus for resilient message and data exchange across systems.
- Monitor and continuously optimize data workflows for reliability, performance, and cost efficiency.
- Manage code repositories, CI/CD pipelines, and deployments using Azure DevOps, ensuring high-quality documentation and best practices.
- Work closely with business stakeholders and technical teams to translate requirements into scalable data solutions and provide technical leadership.
Requirements
- 5+ years of experience in Data Engineering / Data Platform development.
- 3+ years of hands-on experience with Azure Databricks.
- Strong experience with Azure Data Factory, ADLS Gen2, and Synapse Analytics.
- Proven experience in building enterprise-scale data pipelines.
- Hands-on experience building application and API integrations using Azure Functions, Logic Apps, and Azure API Management.
- Experience working in Agile/Scrum environments and full SDLC lifecycle.
- Strong proficiency in Python (PySpark), SQL, and experience working with Databricks notebooks for scalable data processing and transformation logic.
- Deep knowledge of ETL/ELT design patterns, including Slowly Changing Dimensions (SCD), medallion architecture (bronze, silver, gold), and data modelling for analytics.
- Expert-level experience with Azure Data Factory / Synapse Pipelines, Azure Data Lake Storage, and Azure Databricks including Delta Lake.
- Hands-on experience designing integration and API solutions with Azure Functions, Logic Apps, Service Bus / Event Grid, and Azure API Management, including REST API design and secure authentication (OAuth 2.0 / managed identities).
- Advanced hands-on experience with Spark optimization, cluster management, job orchestration, and performance tuning in Databricks.
- Design-first and quality-focused mindset.
- Comfortable working in ambiguity and evolving requirements.
- Strong communicator able to explain technical concepts to non-technical audiences.
- Proactive, collaborative, and continuous improvement oriented.
- Demonstrates strong sense of urgency and ownership.
Nice to have
- Experience with streaming technologies
- Experience with Microsoft Fabric
- Experience with CI/CD for data platforms
- Experience with Power BI
Benefits
- Opportunity to lead and shape the organization's modern data platform strategy, especially around Azure and Databricks adoption.
- Work on high-impact data initiatives, enabling analytics, AI, and digital transformation programs across the business.
- Part of an IT function evolving from delivery-focused to value-driven, with strong executive visibility.
- Opportunity to define best practices under the OneGP model.
- Meaningful ownership, technical stretch, and the chance to work with modern Microsoft technologies, including Power Platform, Azure integrations, and emerging AI and Copilot capabilities.
Additional details
- Reliable and scalable Azure integration architectures with 99.9% uptime, optimized data throughput, and minimal technical debt; clear technical and API documentation; strict adherence to security governance; and seamless data flow that earns positive feedback from business stakeholders.