Dataops Engineer or database administration | Permanent Remote
PradeepIT Consulting Services Pvt Ltd
IndiaremotePosted 23 days ago
Skill Required
DataOps-EngineerDatabase-AdministratorData-EngineerRemote-Database-AdministratorDatabase-Operations-EngineerSenior-Database-Administrator-(SQL-NoSQL)Database AdministratorSystem AdministrationBackup and RecoveryQuery Optimizationdata engineeringDockertroubleshootingETLAWSGCPSQL ServerEngineeringPostgreSQLKubernetesautomationdevelopingObservabilityTerraformdesigninganalyticsMongoDBsecuritybuildingAnsibleTestNGHadoopFulltime
Key highlights
- Minimum 5 years of experience required
- Focus on energy and finance sector software
- Immediate joiners preferred
- Strong SQL skills required
- Experience with AWS, Azure, or GCP required
Role overview
We are looking for a talented individual to join a team of passionate and highly-skilled technology professionals in creating leading customer-centric software for the energy and finance sector.
Responsibilities
- Building and optimizing data pipelines to facilitate the extraction of data from multiple sources and load it into data warehouses.
- Using automation to streamline data processing, including automating manual processes such as data extraction and testing.
- Managing the production of data pipelines to provide organizations with access to structured datasets and analytics.
- Designing data engineering assets and developing frameworks to support an organization's data demands.
- Facilitating collaboration by communicating with other data and BI team members to enhance the quality of data products.
- Executing automated testing at every stage of a pipeline, including unit tests, performance tests, and end-to-end tests.
- Testing and adopting solutions and tools that adhere to DataOps best practices.
- Ensuring data security standards are applied across data pipelines.
- Reducing waste, identifying gaps, and improving data development and deployment processes.
- Assisting in consolidating multiple databases across different cloud providers into a unified, managed environment.
- Identifying performance bottlenecks in MongoDB and other database systems and implementing optimizations such as indexing, query tuning, and database configuration enhancements.
- Managing and maintaining DataLake Bronze/Silver/Gold storages and identifying the right data repository for specific workloads.
- Collaborating with QA and development teams to establish best practices for test environments, including data seeding, cleansing sensitive data, and maintaining consistent data sets.
- Integrating database improvements into the CI/CD pipeline and Infrastructure as Code (IaC) workflows using tools like Terraform.
- Utilizing SQL skills to create and optimize complex queries, stored procedures, and database views across Postgres, MySQL, MS SQL Server, and MongoDB.
- Performing routine database administration tasks, including backup and recovery, monitoring, security, and user management.
- Developing and maintaining automation scripts and tools to streamline database administration tasks.
- Working closely with cross-functional teams, including developers, system administrators, QA engineers, and DevOps personnel.
- Creating and maintaining technical documentation, including database design specifications, standard operating procedures, and troubleshooting guides.
- Staying updated with trends in database management, DevOps, and cloud computing to propose and implement innovative solutions.
Requirements
- Minimum 5 years of experience.
- Proven experience as a Database Administrator or DataOps Engineer.
- Strong knowledge of database management systems, such as Oracle, MySQL, PostgreSQL, MongoDB, and MS SQL Server.
- Experience with managing ClickHouse cluster or similar Data Warehouse.
- Proven experience with Big Data storage technologies such as S3 and HDFS.
- Proficiency in database administration, performance tuning, and troubleshooting.
- Experience with infrastructure as code tools, such as Terraform, Ansible, or CloudFormation.
- Solid understanding of DevOps principles and practices, including CI/CD workflows.
- Strong SQL skills and ability to optimize complex queries across multiple database platforms.
- Experience with cloud platforms, such as AWS, Azure, or Google Cloud Platform.
- Familiarity with containerization technologies, such as Docker and Kubernetes.
- Strong problem-solving skills and the ability to work independently and as part of a team.
- Excellent communication and collaboration skills.
Nice to have
- Experience with ELK and Hadoop.
- Prior experience with SSRS (SQL Server Reporting Services).
Additional details
- Immediate joiners or candidates with less than 30 days notice period are most welcome.
- Role: Cloud System Administration
- Industry Type: IT Services & Consulting
- Originally posted on Himalayas