Senior Data & Integration Engineer – Incident Management Platform

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data & Integration Engineer – Incident Management Platform based in Brazil.

We are seeking an experienced Senior Data & Integration Engineer to design and build a centralized Incident Management Platform that connects production systems, operational tools, and cloud-based data infrastructure. In this role, you will develop robust integrations and data pipelines that transform incident management processes into reliable, auditable, and governed data products. You will work extensively with Databricks, AWS, APIs, and AI-powered agents to streamline incident workflows and improve operational visibility. Your contributions will support critical Site Reliability Engineering (SRE) metrics, incident analysis, and automated decision-making. You will also establish strong engineering practices around data quality, security, testing, and system reliability. This is an exciting opportunity to take ownership of a strategic technical initiative while collaborating with an international, distributed engineering team.

Accountabilities:

• Design, develop, and maintain production-grade API and webhook integrations connecting alerting platforms, Jira Cloud, Jira Service Management (JSM), and internal services with centralized data infrastructure.
• Build and implement AI-agent integrations within Jira workflows, including tool calling, structured outputs, auditable write-backs, and human-in-the-loop approval mechanisms.
• Develop reliable and scalable data pipelines using Databricks, Delta Lake, PySpark, and SQL to ingest and process data from AWS S3 and other integrated systems.
• Ensure data pipeline reliability through incremental ingestion, idempotent processing, schema evolution, and data reconciliation mechanisms.
• Design and maintain governed incident data models and curated datasets supporting operational and SRE performance metrics, including Mean Time to Detect (MTTD), Mean Time to Resolve (MTTR), incident coverage, and recurring incident analysis.
• Establish and maintain data governance practices, including documented data lineage, access controls, data retention policies, and appropriate security measures.
• Develop comprehensive testing strategies and automated test suites to validate integrations, data pipelines, and AI-powered workflows.
• Implement failure recovery mechanisms, data backfills, and reconciliation procedures to ensure platform resilience and data consistency.
• Create clear operational documentation, technical specifications, and runbooks to support ongoing maintenance and knowledge transfer.
• Take end-to-end ownership of technical deliverables, ensuring successful implementation, testing, deployment, and handover to internal operations teams.
• Collaborate with engineering, operations, and other technical stakeholders to ensure the platform meets business and operational requirements.
• Contribute to continuous improvement initiatives focused on system reliability, automation, scalability, and engineering efficiency.

Requirements:

• At least 5 years of professional experience in Data Engineering, Backend Integration Engineering, or a closely related technical role.
• Proven experience designing, developing, and maintaining production-grade data pipelines, backend services, and system integrations.
• Strong hands-on expertise with Databricks, Delta Lake, and PySpark or Spark SQL in production environments.
• Experience working with Databricks jobs, workflows, medallion architecture, and incremental data ingestion strategies.
• Demonstrated ability to build and maintain REST APIs, webhooks, and lightweight backend services using Python frameworks such as FastAPI or Flask.
• Strong understanding of API authentication, retry mechanisms, rate limiting, error handling, and idempotency.
• Practical experience with AWS services, particularly Amazon S3 and IAM, for secure data storage, access management, and ingestion workflows.
• Hands-on experience integrating Large Language Models (LLMs) or AI agents into real-world business workflows.
• Understanding of agentic workflow implementation, including tool calling, human-in-the-loop validation, structured outputs, and comprehensive audit logging.
• Strong software engineering fundamentals, including Git version control, CI/CD automation, and automated unit and integration testing.
• Ability to develop clear technical documentation, operational procedures, and system recovery runbooks.
• Advanced professional English proficiency, both written and spoken, with the ability to communicate effectively across multicultural and globally distributed teams.
• Strong analytical thinking, problem-solving abilities, technical ownership, and attention to detail.
• Ability to work independently, manage priorities, and collaborate effectively in a remote engineering environment.

Nice to have:

• Direct experience integrating Jira Cloud and Jira Service Management through APIs and webhooks.
• Familiarity with data governance and security tools, particularly Databricks Unity Catalog, row-level and column-level security, data masking, and Personally Identifiable Information (PII) protection.
• Understanding of Site Reliability Engineering (SRE) practices and incident response metrics, including MTTD and MTTR.
• Experience with observability and monitoring platforms such as AWS CloudWatch, Datadog, or New Relic.
• Previous experience in fintech, payment platforms, or highly regulated data environments.

Benefits:

• Work arrangement: 100% remote position.
• Contract duration: Initial 3-month contract, with the possibility of extension to 6 months.
• Strategic impact: Opportunity to contribute to a high-visibility engineering initiative involving the development of a centralized incident management platform.
• Technical environment: Hands-on exposure to modern technologies, including Databricks, Delta Lake, PySpark, AWS, APIs, and AI-powered automation.
• International collaboration: Work with a multicultural, globally distributed team and experienced technical leaders.
• Professional development: Opportunities to expand technical expertise and contribute to complex, high-impact engineering projects.
• Growth opportunities: Potential to develop professionally through challenging technical responsibilities and exposure to modern engineering practices.
• Collaborative culture: Join an inclusive, remote-first environment that values technical excellence, autonomy, innovation, and knowledge sharing.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether?    Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.     #LI-CL1