Senior Data Engineer, Telemetry & Analytics Tooling

We are looking for a Senior Data Engineer to build and extend the framework and tooling that our telemetry and analytics run on: collection, transformation, aggregation, access and visualization. The aim is for product managers, project managers and engineers to answer most of their own analytics and research questions without going through a specialist.

Over the past three years we have standardized how telemetry and product data are collected, made that data available for analysis in UI tools (Kibana, Tableau), and taught our product and project managers to use those tools and analyze data themselves.

You will also take on the analyses that self-service cannot reach: how our services operate, perform and stay stable, and how our features are actually used.

You will be part of

A Telemetry/Data team that works closely with product owners and development teams. You will own the tools and pipelines that collect and expose data across the department, and you will manage two data engineers working on data collection, processing and analytics.

Responsibilities

• Design, build and evolve the framework and tooling for collecting, transforming and aggregating telemetry and product data, and adjust it as products and services change
• Build self-service capability: data models, aggregations, dashboards and tooling that let non-specialists do their own analysis and research
• Process and model OpenTelemetry data (traces, metrics and logs) at scale
• Manage two data engineers: set technical direction, review designs and grow the team's capability
• Work with frontend and backend development teams to instrument their systems and report telemetry and analytics data consistently
• Take on the analyses that go beyond self-service: how services operate, perform and remain stable, and how features are used
• Own data access and quality: make the right data available to the right people, in a form they can trust
• Enable colleagues through documentation, dashboard patterns and hands-on support
• Present findings using clear data visualization

Requirements and skills

• 5+ years of experience building data platforms, telemetry pipelines or analytics tooling
• Strong programming skills in both Java and Python
• Deep experience with the ELK Stack (Elasticsearch, Logstash, Kibana): index and mapping design, ingest pipelines, aggregations and Kibana dashboards
• Experience with OpenTelemetry across traces, metrics and logs: instrumentation, collectors and the Elastic OpenTelemetry distributions (EDOT)
• Experience building data collection systems end to end, from instrumentation through to consumption
• Experience leading or managing engineers, and setting technical direction for a small team
• Experience partnering with development teams to standardize instrumentation across frontend and backend systems
• Strong analytical and math skills (e.g. statistics) applied to performance, stability and usage data
• Problem-solving aptitude and business acumen
• Excellent communication skills, including the ability to teach non-specialists to use data tooling themselves
• BSc/BA in Computer Science, Engineering or a relevant field

Good to have

• Experience with AWS analytics services (Amazon EMR, Amazon Athena)
• Understanding of machine learning and its application to anomaly and trend detection in telemetry
• Knowledge of SQL
• Experience with business intelligence tools (e.g. Tableau)
• Graduate degree in a quantitative field

Benefits

• Competitive salary, annual performance-based bonus, and stock grant awards
• 401(k) retirement plan with competitive company match
• Excellent health and wellness benefits, including medical, dental, and vision benefits. 100% employer-paid medical premiums, with generous employer contributions to dental & vision plans as well.
• Wellness screening and assessments, health coaches, and counseling services through an Employee Assistance Program (EAP)
• Generous paid parental leave (up to 16 weeks paid parental leave for eligible employees)
• Company-paid basic life insurance, accidental death & dismemberment (AD&D), and short- and long-term disability coverage
• Flexible Spending Accounts (Healthcare, Dependent Care, and Commuter FSAs)
• Quarterly fitness stipend to offset costs associated with traditional gym and fitness memberships or fees
• Education reimbursement and professional development opportunities
• Legal services, telehealth access, and voluntary insurance options
• Backup child and adult care support through Care.com
• Daily lunch allowance and fully stocked kitchen with healthy breakfast and snack options